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AN EXPERIMENT IN THE EDUCATIONAL 
AND VOCATIONAL GUIDANCE OF 
TENTH-GRADE PUPILS 


PERCIVAL W. HUTSON 
University of Pittsburgh 
and 
ARTHUR D. WEBSTER 
Springfield Township High School 
Chestnut Hill, Philadelphia, Pa. 


XPERIMENTATION in educational and vocation- 

al guidance is eminently justified because guidance 
is carried on in thousands of schools and colleges over 
the land with very little objective evidence of its value. 
What is the worth of its various techniques, procedures, 
programs? A canvass of educational literature shows 
that investigations to answer this question have been few 
and far between. Guidance lingers long in the promo- 
tional stage, a ministry too largely accepted on simple 
faith in the unsupported assertions of its protagonists. 
Its many instruments and techniques need testing. Those 
found ineffective can then be modified or discarded. 
Those proving valid can be recommended for wider 
usage. To contribute to the fulfillment of this need the 
research here described was undertaken. 


The Problem Studied 


The specific problem of the investigation was to find 
out what results came from the employment of a pro- 
gram of vocational and educational guidance with the 
222 pupils of the tenth grade in Lincoln High School, 
Ellwood City, Pennsylvania. In particular, it was de- 
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cided to measure the degree of attainment of the follow- 
ing goals: 


A. Making wisely the decision to go to college or | 


not to go 

B. Making a vocational choice in harmony with 
ability 

C. Choosing the following elective subjects in ac- 
cordance with aptitude for them: 
1. French 
2. Shorthand 
3. Advanced algebra 


The program was carried on during the school year 
1937-38, the first year that a counselor was appointed in 
the school and guidance activity formally inaugurated. 
Choice of the tenth-grade group for measurement of the 
effectiveness of the guidance program in reaching the 








t 


goals stated above seemed particularly justified because — 


the tenth-grade pupil had various opportunities for 
choice. If he was pursuing a college-preparatory curric- 
ulum based on a decision made when he entered the ninth 
grade, he might yet change his mind and graduate from 
the general curriculum. If he had been following the 
general curriculum, in the absence of any vocational 
objective, and his ambitions had just crystallized about 
a vocation requiring college training, he could still per- 
haps realize his belated purpose by electing the right 
subject, such as French, in the eleventh and twelfth 


grades. Similarly, he could decide to take or not to take | 


the shorthand and typing sequence open to juniors and 
seniors. Tenth-grade pupils in many high schools enjoy 
this diversity of opportunity for the last two years. 


Procedure of the Experiment 


The essence of the experiment was to compare the 
degree to which the eleventh-grade class has attained the 
above-mentioned goals, A, B, and C—without benefit of 
guidance—with the degree to which the tenth-grade class 
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was to attain the same goals, after being subjected to the 
guidance program hereinafter outlined. The eleventh- 
grade class was the “control” group, the tenth-grade class, 
the “experimental” group. These consecutive classes, 
numbering 249 and 222, respectively, were assumed to 
be comparable in ability. Measurements of each group, 
taken as each entered upon eleventh-grade work, proved 
the assumption to be justified. 

A. With the control group. The first steps in the 
experiment were _taken in September, 1937, when meas- 
urements were made of the eleventh-grade group, and 
items of information were gathered concerning them, 
as follows: 

Intelligence—Henmon-Nelson Test of Mental Abil- 

ity ; 

Scholastic achievement — Progressive Achievement 
Test, Advanced Battery; 

Mechanical ability—Revised Minnesota Paper Form- 
board Test; 

General scholastic success—Quality point average of 
marks in all academic subjects taken in the ninth 
and tenth grades; 

Success in the study of English—Quality point aver- 
age of marks earned in English taken in the ninth 
and tenth grades; 

Success in the study of mathematics—Quality point 
average of marks earned in mathematics taken in 
the ninth and tenth grades; 

Educational plans and choice of ogccupation—pro- 
cured by questionnaire. 


In addition to these items obtained on all pupils, the 
members who were beginning the study of French were 
given the Luria-Orleans Modern Language Prognosis 
Test before they had any class work in the subject. 

At the conclusion of the first semester of the school 
year, teachers’ marks were obtained for those members 
of the eleventh grade who had elected shorthand, ad- 
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vanced algebra, and French. Those who took French 
were also given a standardized achievement test based 
on the textbook they used. These measures of the achieve- 
ment of the control group were tabulated in correlation 
with the various measures of prediction listed in the 
preceding paragraph. As will be presently shown, these 
correlation tables were used in guiding the experimental 
group. 

B. With the experimental group. Without any pre- 
liminary canvass of the aspirations of the tenth-grade 
class a program of group and individual counseling was 
inaugurated early in the second semester. Weekly home- 
room guidance programs of thirty minutes’ duration 
were conducted by the hom room teachers of these 
pupils in accordance with outlines and materials fur- 
nished by the counselor and discussed with him. Four 
weeks were spent in consideration of college going, five 
were devoted to occupation choosing, and four were 
given to study of the problems of choosing elective sub- 
jects for the eleventh grade. In addition to the group pro- 
grams, individual counseling was done by the home-room 
teachers and by the counselor whenever pupil choices 
seemed questionable and whenever pupils sought advice. 

1. Making the college decision. In taking up this 
problem, a special effort was made to help each pupil 
determine the degree to which he possessed college abil- 
ity. Since success in high-school subjects is known to be 
the best single index to college success, and since data 
are available showing this relationship in simple terms, 
the pupils’ thinking was directed along these lines. 
First, they were asked to compute from the marks they 
had earned in academic subjects in the ninth and in the 
first half of the tenth grades their quality point averages, 
using the values 4, 3, 2, 1, and 0 for the letter grades A, 
B, C, D, and E, respectively. With teacher assistance 
and careful supervision this was accurately done. The 
quality point averages were then reported and ranked 
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for the entire class from the highest to the lowest, the 
distribution was divided into tenths, and each pupil was 
informed as to the tenth of his class in which he stood. 

Second, to each pupil was given a copy of a chart 
from Johnston’s report of his investigation of the rela- 
tionship between the high-school success of graduates 
of the Minneapolis and St. Paul high schools in 1922, 
1923, and 1924, and their success at the University of 
Minnesota.’ The chart was a bar diagram showing, for 
each tenth of the high-school class, the number entering 
the University of Minnesota and the number who were 
successful. From this objective information the pupils 
were able to determine their approximate chances for 
success in college. Discussion revolved about the congru- 
ity of the analogy of Ellwood City pupils with those 
charted by Johnston, and also about reasons why the rela- 
tionship between high-school and college success is no 
more perfect or imperfect than it is. 

Besides the foregoing activity, there was some study 
of college catalogs and rather careful reading of a brief 
mimeographed booklet of information prepared by the 
counselor to answer typical questions that pupils might 
raise relative to the college decision. 

2. Choosing an occupation. Using an occupational 
analysis blank, the pupils gathered essential information 
concerning the one or more vocations which most inter- 
ested them. They were aided in using the library by an 
extended bibliography of all the occupational materials 
available, and they were encouraged in contacting suc- 
cessful workers of the community in order to obtain first- 
hand information. Oral reports to the home-room groups 
stimulated group discussions concerning occupations and 
occupation choosing. At the conclusion of this activity 
the pupils were asked to fill out a blank stating their occu- 
pational preference and their educational plans. 





1J. B. Johnston, “Vocational and Educational Guidance in the High School and 
Its Relation to Higher Education,” Vocational Guidance Magazine, VII (1928), 15-21. 
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3. Choice of elective subjects. Guidance to influence 
the pupils in their choices of elective subjects rested 
largely on the assumption that success in the study of 
French, shorthand, and advanced algebra can be pre- 
dicted to a considerable degree from the record of 
achievement in the study of related subjects taken previ- 
ously. Accordingly, double-entry tables were drawn up 
showing the relation of the success of the members of the 
control group in each of these three subject fields at the 
end of the first semester, with their success in related sub- 
jects completed in previous years. The pupils of the ex- 
perimental group were given mimeographed copies of 
these tables and were aided in interpreting them and in 
making a personal application of them. This procedure 
gave the guidance program an objective character, which, 
it seemed, would make it more influential with the pupils 
than the unsupported counsel of their teachers. 

a. French. In addition to the measure of proficiency 
in the study of English which notably forecasts success 
in the study of French, the pupils were given the Luria- 
Orleans Modern Language Prognosis Test, the same test 
which had been given the previous September to those 
members of the control group who had elected French. 
After the tests were marked, each pupil was given a card on 
which was written his score, and with it a mimeographed 
copy of Table 1, which shows, as the title indicates, the 
record of the control group in first-semester French com- 
pared with their scores on the Luria-Orleans test. 

The members of the experimental group were taught 
how to read the table, the first illustrative reading being 
as follows: “Of the seven persons who scored between 
170 and 179 on the test, about 71 per cent made B in 
French at the end of the first semester, and about 29 per 
cent made A.” Another reading, which emphasizes the 
personal application, is as follows: “If my French prog- 
nosis test score lies between 120 and 129, then according 
to the results achieved by those who have preceded me, 
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TABLE 1 

RELATION BETWEEN SCORES EARNED ON LURIA-ORLEANS MODERN 

LANGUAGE PROGNOSIS TEST BY MEMBERS OF THE CONTROL GROUP 
AND THEIR SUCCESS IN FIRST-SEMESTER FRENCH 











Number French Grades 

of 
Scores Cases E D Cc B A Totals 
ern 7 71.4 28.6 100.0 
ee ere 12 16.7 41.7 41.7 100.1 
(eee re 10 60.0 30.0 10.0 100.0 
SURE 628 Gian ke 46s 8 12.5 25.0 62.5 100.0 
SEE, wis wis ic aie. 358 10 10.0 50.0 40.0 100.0 
SNM. fos 0 tok wes erenk 11 63.6 18.2 18.2 100.0 
See z 100.0 100.0 
SEINE oss oaks Kaw bee 4 50.0 50.0 100.0 
SOE ccbicwa hesodeaes 4 75.0 25.0 100.0 
SS rrr 1 100.0 100.0 
oe ere 4 75.0 25.0 100.0 
SEER GHE 0:5 s gusteigeste yeieve 1 100.0 100.0 
WONG i scan Seana 74 





| I have about 18 chances in 100 of making a B, 18 chances 
, in 100 of making a C, and 64 chances in 100 of making 
a D.” While home-room teachers helped the pupils to 
realize that the number of cases at each interval in the 
table was so small as to render important the factor of 
chance in their distribution, they nevertheless called at- 
tention to the general pattern formed by the 74 cases in 
the table and helped each pupil to grasp its meaning 
for him. 

The pupils were then asked to figure their quality 
point averages in English, taking marks earned in the 
ninth grade and the first semester of the tenth grade. The 
teacher put Table 2 on the blackboard té show the pupils 
how well members of the control group had succeeded 
in French in relation to their standing in English. Each 
pupil was helped to read the table and to interpret its 
meaning for himself in the light of his own English qual- 
. ity point average. 

b. Shorthand. Shorthand teachers agree that one of 
y the best predictors of success in the study of shorthand 
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TABLE 2 
RELATION BETWEEN QUALITY POINT AVERAGE OF GRADES EARNED 
IN NINTH AND TENTH GRADE ENGLISH BY MEMBERS OF THE CON- 
TROL GROUP AND THEIR SUCCESS IN FIRST-SEMESTER FRENCH 











Q PLA. Number French Grades 

English . E D Cc B A Totals 

A 

CL | ODER era 7 $7.1 42.9 100.0 
(25-34) WeEaheee anes 39 10.3 33.3 43.6 12.8 100.0 
maio iveanseae awe 23 34.8 34.8 17.4 13.0 100.0 
ae ee) Assis ckaiwas 5 80.0 20.0 100.0 
ones) (aneatw hows’ 
Lo ee eee 14 





is to be found in previous success in English. Accord- 
ingly, for the guidance of these tenth-grade pupils in 
deciding whether or not to elect shorthand, Table 3 was 
presented for their study and self-application. A similar 
table, not shown here, compared total academic average 
and shorthand grades. 


TABLE 3 
RELATION BETWEEN QUALITY POINT AVERAGE OF GRADES EARNED 
IN NINTH AND TENTH GRADE ENGLISH BY MEMBERS OF THE CON- 
TROL GROUP AND THEIR SUCCESS IN FIRST-SEMESTER SHORTHAND 











Q PA. Number Shorthand Grades 

English ioe E D Cc B A Totals 
A 

(5S |) re 4 25.0 75.0 100.0 

(25-34) yale ios ome oie 37 59.5 32.4 8.1 100.0 

cena cee nese 64 26.6 $13 32.8 9.4 100.1 

03-14) Eveue Wea le ste 13 76.9 23.1 100.0 

(09-04) eicmeue abies 

BN. watesccassess “118 
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c. Advanced algebra. For helping pupils to decide 
on the election of this subject, double-entry tables show- 
ing the predictive significance of ninth- and tenth-grade 
mathematics and of the total academic average were 
given them, the tables being made from the records of the 
control group, as for English and shorthand. 


The Findings 

Did the experimental group, subjected to the guid- 
ance program just described, choose more wisely than 
the control group? Regarding the college decision and 
the choice of occupation, only long-term follow-up 
studies could give the ultimate answer. However, the 
effectiveness of these two phases of the guidance program 
could be appraised by comparing the two groups with 
reference to their possession of the abilities necessary for 
success in the fields in which they made similar choices. 
This step was taken, and data will be presented from 
these comparisons. Regarding the choosing of elective 
subjects, the same method of evaluation was employed, 
but it was possible also to make the more fundamental 
comparison of degrees of success enjoyed by the two 
groups of pupils. Data will be presented from both of 
these measurements. 

4A. Making the college decision. From the control 
group, 66 pupils stated that they intended to go to col- 
lege—39 boys and 27 girls; from the experimental group, 
the number was 64—36 boys and 28 girls. The college- 
going pupils comprised about 26 per cent of the total 
membership of the control group and about 29 per cent 
of the experimental group. These two groups of pupils 
were compared on several measures of ability and col- 
lege aptitude — general intelligence, achievement-test 
scores, quality point averages, and percentile ranks in 
class. Only in general intelligence were the groups ap- 
proximately equal; on the other measurements the ex- 
perimental group was definitely of superior quality. Since 
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numerous researches have demonstrated that percentile 
rank in class is the best single index in the prediction of 
college success, the data for that comparison of the two 
groups are here presented in Table 4. The most marked 
differences between the groups to be observed in the table 
proper are in the percentages of college-going pupils 
from the highest tenth of the classes and also from the 
lower half of the classes. To measure the difference in 
college aptitude of the two groups more exactly, the 
quartiles and medians of each distribution are shown at 
the foot of the table. The reader will note the evidence 
of some selection for college among the members of the 
control group, but the selection is appreciably greater in 
the experimental group. 


TABLE 4 


PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS WHO STATED THE INTENTION OF GOING 
TO COLLEGE,—DISTRIBUTED ACCORDING TO PERCENTILE RANK IN 
CLASS AS DETERMINED BY QUALITY POINT AVERAGES OF GRADES 
EARNED IN ACADEMIC SUBJECTS TAKEN IN NINTH AND TENTH 














GRADES 
Control Group Experimental Group 
Percentile Boys Girls Total Boys Girls Total 
Rank (39) (27) (66) (36) (28) (64) 
rer Be | 14.8 10.6 30.6 25.0 28.1 
E55 eins eeaws 20.5 7.4 15.2 41.1 17.9 14.1 
WEED 644k Ooucsncaac 79 40.7 21.2 16.7 17.9 17.2 
EF Cee 23.1 7.4 16.7 11.1 17.9 14.1 
Pree 10.3 11.1 10.6 13.9 3.6 9.4 
ae ae 15.4 3.7 10.6 2.8 3.6 3.1 
Se 2.6 ci 1.5 5.6 7.1 6.3 
SD. bxchstanancwwe 7.7 * Hf 6.1 8.3 3.6 6.3 
EDs ok os ch peu aks 2.6 3.7 3.0 an 3.6 1.6 
Be Mest eks ake sees 2.6 7.4 4.5 
WE sto cewmae oe 100.2 99.9 100.0 100.1 100.2 100.2 
Upper Quartile ........ 81.8 79.3 80.5 91.8 90.0 91.0 
eee 64.1 73.2 68.2 75.0 75.9 75.4 
Lower Quartile ....... 45.9 55.9 49.3 56.0 62.0 58.2 





B. Choosing an occupation. A program of voca- 
tional guidance should be judged according to its satis- 


12 





















eae SS Se 


TwNeoinit: 





aR AARP 





EDUCATIONAL AND VOCATIONAL GUIDANCE 


faction of the following two criteria: (1) the extent to 
which vocational choices are brought into harmony with 
social need, and (2) the extent to which choices are 
brought into harmony with abilities. 

To obtain evidence for the evaluation of the brief 
guidance program on the first of these criteria, the pupils 
of the two groups were distributed according to the 
United States Census classification of the occupations 
they had chosen. These distributions were then paralleled 
by the distributions of employed workers in Ellwood 
City, in Pennsylvania, and in the United States as a 
whole. All are shown together here as Table 5. Assuming 
that the actual distribution of the gainfully employed 


TABLE 5 
PERCENTAGE DISTRIBUTIONS OF PUPILS ACCORDING TO OCCUPA- 
TIONAL CHOICES AND OF WORKERS EMPLOYED IN THE SAME OCCU- 
PATIONAL GROUPS—IN ELLWOOD CITY (1937), IN PENNSYLVANIA 
(1930), AND IN THE UNITED STATES (1930) 











Experi- 

Occupational Control mental Ellwood Pennsyl- United 

Category Group Group City vania States 
MARIN a5 o50)4 54 Slo cassia 2 aoe 0.9 ete 6.7 21.4 
Forestry and fishing.......... 1.6 2.3 wdee 0.1 0.5 
Extraction of minerals........ pik ore ics 8.0 2.0 
Manufacturing and 

mechanical industries ...... 17.7 14.0 66.5 38.1 28.9 
Transportation and 

communication ............ 4.0 10.4 0.8 8.6 7.9 
MR eit 5 Sass ahd X oe. sie rs Side 4.9 10.4 11.3 12.3 12.5 
PUnHC SETVICE. 03.6560 6c sec cess 0.8 0.5 2.1 1.8 1.8 
Professional service .......... 36.1 27.5 43 6.4 6.7 
Domestic and personal service.. 4.4 6.8 4.1 8.9 10.1 
Clerical occupations .......... 28.1 26.1 10.7 8.9 8.2 
Unclassified or no choice...... 2.4 14 aes 
WENES) Giyikcseaweseaawuwse ds 100.0 100.3 99.8 99.8 100.0 





members of society indicates roughly the social need for 
workers in the various fields, it is evident that both the 
control and experimental groups are considerably out of 
line in their choices. Particularly, the reader’s attention 
is called to the small percentages of pupils choosing oc- 
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cupations in the manufacturing and mechanical indus- 
tries—a category which absorbs two-thirds of Ellwood 
City workers and nearly two-fifths of Pennsylvania’s 
gainfully employed. Corresponding discrepancies are to 
be observed in the fields of professional service and cleri- 
cal occupations. In common with the findings in other 
similar studies these high-school pupils tend to over- 
crowd these fields. 

Evidence that the guidance program with the experi- 
mental group had some effect is to be observed most 
clearly in the fact that the percentage of this group choos- 
ing occupations in professional service was considerably 
smaller than the corresponding percentage of the control 
group,—a change in the right direction. Something also 
may be said for the fact that the percentages of the ex- 
perimental group choosing occupations in the fields of 
transportation and communication and of trade are more 
nearly in line with the distribution of Pennsylvania 
workers than is true of the control group. 

Table 6 presents a different classification of occu- 
pational choices, based more clearly on extent or level 


TABLE 6 


PERCENTAGE DISTRIBUTIONS OF THE PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS, ACCORDING TO OCCUPATIONAL CHOICES 














Control Experimental 

Occupational Group Group 

Category (249) (222) 
PINE OS Sc Sc Daten a chd sahie swe was .. 18.5 13.1 
NS ee reer 18.1 174 
eS . 829 32.9 
Ee a's an yu wiow.e® . 24.5 30.6 
Unskilled or no choice...................: . 6.0 6.3 
NAS Ss he os el ds cc pk sonld Gp ew wie 100.0 100.0 





of training required—the professional occupations being 
those which typically require four or more years of col- 
lege or university training, and the semi-professional 
occupations typically involving one, two, or three years 
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of training beyond high school. Some advantage for the 
program of guidance is shown in this table, as the 
smaller percentage of the experimental group choosing 
professions and the larger percentage choosing skilled 
trades bring them closer to the distribution of actual 
workers than is true of the control group. 

Turning to the other criterion for evaluating voca- 
tional choice, the central question is, Did the experi- 
mental pupils choose occupations more nearly in line 
with their abilities than did the control pupils? Only a 
few coarse measurements can be offered in response to 
this question. First compared are those shown in Table 6 
as having chosen professional occupations. Since such 
individuals must have academic aptitude in a rather high 
degree in order to pursue successfully the training neces- 
sary to entering upon their chosen vocations, comparisons 
of academic aptitude were made by measuring them with 
the Henmon-Nelson Test of Mental Ability and the 
Progressive Achievement Test, and also by taking ac- 
count of their academic records in the first two years of 
high school. On the Henmon-Nelson test there proved to 
be only a slight difference between the two groups—a 
difference favoring the experimental group. The differ- 
ence was a little larger and more consistent in scores on 
the Progressive Achievement Test. On quality point 
averages, the difference between the two groups was 
marked, the summary of the distributions being as 
follows: 

Control -Experimental 
Group Group 


Upper quartile ...... 3.06 3.40 
re 2.47 3.10 
Lower quartile ...... Z17 2.52 


As has already been pointed out, the last measure is the 
most predictive of college aptitude. 
Since semi-professions, as defined in this study, in- 
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volve one, two, or three years of study beyond high 
school, academic or college aptitude seems to be an essen- 
tial attribute in a person selecting one of them, just as in 
the case of the professions. Accordingly, the same com- 
parisons were made of pupils in this category as were 
made of the pupils choosing professions. Similar degrees 
of differences were found on all measures in favor of the 
experimental members. 

For the sake of making a valid comparison with num- 
bers large enough to minimize the factor of chance, pu- 
pils choosing professions and semi-professions are com- 
bined in Table 7. The basis of comparison of the control 
and experimental groups is percentile rank in class, the 
same basis as was employed in Table 4. A study of this 
table, and especially of the summary of the distributions, 
should make it clear that the experimental group was 
definitely superior to the.control group in attributes im- 


TABLE 7 


PERCENTAGE DISTRIBUTIONS OF THOSE PUPILS OF THE CONTROL 

AND EXPERIMENTAL GROUPS WHO GAVE PROFESSIONS AND SEMI- 

PROFESSIONS AS THEIR OCCUPATIONAL CHOICES — DISTRIBUTED 

ACCORDING TO PERCENTILE RANK IN CLASS AS DETERMINED BY 

QUALITY POINT AVERAGES OF GRADES EARNED IN ACADEMIC SUB- 
JECTS TAKEN IN NINTH AND TENTH GRADES 














Control Group Experimental Group 
Percentile Boys Girls Total Boys Girls Total 
Rank (37) (54) (91) (35) (32) (67) 
EE Vises eR eG eens 8.1 24.1 17.6 34.3 21.9 28.4 
re rer 18.9 74 12.1 11.4 21.9 16.4 
ee rs 10.8 11.1 11.0 17.1 18.8 17.9 
SP Ghana kas ae was 21.6 5.6 12.1 14.3 125 13.4 
Le, dC ae 10.8 9.3 9.9 5.7 9.4 7.5 
DE: GE bow aos <2 eae 13.5 13.0 13.2 2.9 3.1 3.0 
eee 2.7 7.4 5.5 11.4 6.3 8.7 
See a 5.4 74 6.6 2.9 3.1 3.0 
MED sas cctwauees + Se 9.3 5 Bef ng 3.1 1.5 
AD Scuse sacs sane 2.7 5.6 4.4 
MES: Sees dees sn enaem 99.9 100.2 100.1 100.0 100.1 99.8 
Upper Quartile ....... 81.1 88.5 83.8 92.7 88.5 91.3 
eae 64.4 57.8 62.2 77.5 76.6 77.2 


Lower Quartile ....... 46.5 33.6 40.6 61.5 60.0 61.0 
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portant to the occupations in the professional and semi- 
professional categories. 

Did the pupils from the experimental group who 
chose to enter business and clerical occupations and 
skilled trades represent a better matching of abilities and 
aspirations than did the pupils from the control group 
who made similar occupational choices? The question 
was not easy to answer. There are tests of clerical ability, 
but none were applied. There are tests of mechanical 
ability, but it seemed practical to apply only one, the 
Minnesota Paper Formboard Test, which is a group test. 
On this measurement the two groups of pupils choosing 
skilled trades showed no perceptible difference. 

Two other evaluations of vocational choice showed 
no significant difference between the control and experi- 
mental groups. One was the comparison on scores on the 
Minnesota Paper Formboard Test of all pupils who 
chose occupations involving mechanical ability—profes- 
sional, semi-professional, and skilled trades levels. The 
other was the comparison in mathematical ability, as 
shown by mathematics marks earned in ninth and tenth 
grades, of all pupils choosing occupations involving 
mathematical ability. 

That these latter comparisons yielded no evidence of 
value in the guidance program should afford no cause 
for surprise or disappointment. Certainly the vocational 
guidance hereinbefore described was indeed sketchy. 
That the experimental pupils chose professions and semi- 
professions more advisedly must be attributed largely to 
the activities in college guidance to which they had been 
subjected. 


C. Choosing elective subjects. The pupils of the 
experimental group who elected French proved to have 
higher average aptitude for the study of that subject than 
did the corresponding pupils of the control group. This 
superiority was evidenced by the comparison of progno- 
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sis test scores and by comparison of marks in ninth- and 
tenth-grade English, but more significantly by compari- 
son of marks actually earned in first-semester French. 
Distributions and summaries of the marks of the two 
groups are shown in Table 8. They were taught by the 


TABLE 8 


PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND | 


EXPERIMENTAL GROUPS IN FRENCH, ACCORDING TO MARKS 
RECEIVED AT THE END OF THE FIRST SEMESTER OF STUDY 























Numerical Control Experimental 
Marks Values Group Group 
(74) (65) 
iss hssbGeeGwekeuakey 3.5-4.0 10.8 16.9 
_ rer 2.5-3.4 32.4 33.8 
Rertr aA nav uu cae aGlaae 1.5-2.4 23.0 26.2 
See oe eer eee 0.5-1.4 17.6 15.4 
Bites awacanb enamine 0.0-0.4 16.2 YB f 
MRS SES oo sh nua ek shake ass enna deco 100.0 100.0 
Se INNER Coo. aa updae Seabee on ee easex 3.01 3.21 
EE ER SS cc NE Cet aeg iab aw an eeu ee sipauws 2.16 2.47 
SU ENUIED os sires ac 4 caboose mown sovinens xiems 95 1.52 





same teacher, and she was not aware that a controlled 
experiment in guidance was being carried on in the 
school. (This condition of the experiment prevailed also 
in shorthand and advanced algebra, concerning which 
data are yet to be shown.) Presenting approximately the 
same degree of contrast as is evident in Table 8 are the 
distributions of scores earned on a standardized achieve- 
ment test, the medians being 84.7 for the control group 
and 90.5 for the experimental group. 

The guidance program resulted, also, in a superior 
selection of students for the study of shorthand. Evidence 
of this outcome could be shown, if space permitted, by 
presenting a comparison of the two groups on ninth- and 
tenth-grade marks in English, and also on the language 
section (Part V) of the Progressive Achievement Test. 
Presented here, however, are only the marks earned by 
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EDUCATIONAL AND VOCATIONAL GUIDANCE 





the two groups in first-semester shorthand (Table 9). 
The differences are not marked, but they are perceptible, 
and the smaller number of failures in the experimental 


group is especial cause for gratification. 


TABLE 9 


PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS IN SHORTHAND, ACCORDING TO MARKS 
RECEIVED AT THE END OF THE FIRST SEMESTER OF STUDY 




















Numerical Control Experimental 
Marks Values Group Group 
(118) (101) 
Bieta ct eca a ete 3.5-4.0 SA 5.9 
BEING 5 sis eae Saas aes 2.5-3.4 16.1 21.8 
Brater te aie ever owtome sien 1.5-2.4 36.4 34.6 
re hag ice ne ea one 0.5-1.4 19.5 23.8 
_ ee ee eee one 0.0-0.4 22.9 13.9 
POMMAME 5355 Ait vals asa oy ha Ara ees ssorearale Wine aeeieratene 100.0 100.0 
BPMOU MATINEE | G..8 oo joss aulare soos ave ato vals easels aiale Siacmcais 2.35 2.53 
RES SR se re a een Ce emir err 1.66 1.78 
UE MEMEO NO eos 5. 2 in cig hig enw ioe diel ou 014 cae erases 56 92 





With reference to the election of advanced algebra, 
the result of the guidance program is shown in Table 10, 
in which the superior quality of the experimental group 


TABLE 10 


PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS IN ADVANCED ALGEBRA, ACCORDING TO 
MARKS RECEIVED AT THE END OF THE FIRST SEMESTER OF STUDY 














Numerical Control Experimental 
Marks Values Group Group 
(61) (49) 
BN awn kwalvalew sna 3.5-4.0 6.6 14.3 
BR See ke Wixi exican see 2.5-3.4 34.4 38.8 
Re ese fa anny oraaw wae 1.5-2.4 Ba S21 
Bet nig chan chien acs tolanes 0.5-1.4 27.9 14.3 
MEE eh sie sahapia ve ee aan 0.0-0.4 ee - 
UUNNS (1955. oo nina 6 ibaa eyuied Aas kanes Daaiemas 100.0 100.1 
MMT MIRNONID 6065 05's Aw Snd se nic ey a4 ued Sew Iees 2.91 3.17 
SRS ESS ae am eS 2.16 2.53 
SN MEINE oo acs Wie aun are ons wa wines as eniers .90 1.78 
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is unmistakable. To a degree this evidence was cor- 


matics and on their scores on the mathematics sections 
of the Progressive Achievement Test. 


Concluding Comment 


This experiment demonstrates that a program of vo- 
cational and educational guidance can bring about an 


improvement in the choices of high-school pupils. The | 
variable in the experiment was complex, for the reason | 
that a truly practical program of guidance must be com- | 
plex. The decisions concerning vocation and education | 
are interrelated, and they may be formed well only after | 


careful analysis of self and of various avenues of choice. 
Achievement of these goals almost surely entails a num- 
ber of learning experiences. Complexity in this experi- 
ment was further contributed to by the fact that the guid- 
ance activities were performed by several persons — 
home-room teachers,—although directed by one person, 
the counselor. Certainly they varied in their capacity for 
the function, and especially they must have varied in 
their effectiveness in individual counseling. 

To control the experiment as closely as possible, 
marked emphasis was placed on objective procedures. 
Not only did this contribute to uniformity of action on 
the part of the home-room teachers, but it also facilitated 
description of the program. It is believed that the tech- 
nique of the double-entry or probability table is influ- 
ential with pupils, and it is hoped that its extensive illus- 
tration in this research will be considered to constitute 
one of the main values of the study. To predict with cer- 


roborated by comparisons of the two groups on their | 
quality point averages in ninth- and tenth-grade mathe- | 










res 


tainty is a practice that should now be fully recognized © 


as illusory and sure to undermine confidence in counsel- 
ing. Defensible procedure consists of showing the coun- 
selee what his chances of success are in this or that ven- 
ture. Every school should be preparing data which will 
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| help its students to look for themselves into their futures. 
| Because it is impossible to predict with certainty, it 

seems unwise for a counselor to try to evaluate his pro- 
_ gram by counting the individuals who make good choices 
_ and the ones who make poor choices. No such step was 

attempted in this study. Rather, the sounder practice 
' would seem to be the measurement of a group making a 
_ given choice to determine the degree to which they pos- 





| sess some aptitude known to be related to success in the 
* | choice they have made. Thus, one may compare those 
; ' members of a certain group who make a given choice 
- | before guidance with those members of the same group 
"| who make that choice after guidance.? The trouble with 
' _ measurement before and after guidance is, of course, that 
“ | such improvement in choices as may appear, may not 
~ | surely be attributed to the guidance program. Therefore, 
‘ comparing control and experimental groups, as in this 
~ research, should yield more valid results. 
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A PLEA FOR A FUNCTIONAL APPROACH 
TO TEST CONSTRUCTION 


ROBERT W. B. JACKSON and GEORGE A. FERGUSON 
University of Toronto 


iP MOST of our work in education and psychology, 

we are concerned with the general problem of measur- 
ing the abilities of a group or groups of individuals. Ob- 
viously, before we can measure we must have a measuring 
instrument of some kind, and hence we must first consider 
the problems involved in the construction of these meas- 
uring instruments, which we call tests. The primary 
function of these tests is to discriminate between the 
individuals or groups of individuals tested. This ignores 
the question of the validity of the measuring instrument, 
but actually this is of secondary importance. Unless the 
test enables us to discriminate, it is clear that it can possess 
little or no usefulness as a measuring instrument. The 
purpose of the present note is to present briefly a few 
interesting points regarding the discriminatory power of 
tests, and in particular the peculiar kinds of score-dis- 
tributions which we may obtain when a test is designed 
for some particular purpose. 

For some reason or other, most of us -believe that the 
test scores should be approximately normally distributed, 
and in many cases we would discard a test which does 
not give such a distribution of scores. Possibly this belief 
is based on the assumption, generally implicit, that the 
ability in question is normally distributed in the popu- 
lation we are sampling. In constructing a test, there- 
fore, most of us choose a few very easy items, a few 
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more very difficult ones, and the rest of about average 
difficulty, and are quite happy when the distribution of 
test scores turns out to be approximately normal in form. 
It is rather unfortunate that in most cases this does not 
give us the kind of discrimination we want. We obtain 
good discrimination at both ends of the distribution, it is 
true, but as most of the scores lie near the middle of the 
distribution, it follows that for most of the individuals 
we have little or no discrimination. It may be argued 
that if the ability is normally distributed, this is as much 
as we can hope for. In so arguing, however, we forget 
that we do not know, and in fact can generally never 
hope to know, just how the ability in question is dis- 
tributed. The time has come, we think, for us to scrap 
this idea of normal distribution of ability. What we must 


do is to define exactly what we wish our test to do, i.e., | 
define the kind of discrimination we wish to achieve, and | 
then construct a test which will do exactly what we re- | 


quire of it. 


Before proceeding to a discussion of some of the kinds | 
of discrimination we may wish to achieve, let us con- | 
sider a particular example. In many of our examina- | 


tions and tests we wish to determine some critical score 
such that all individuals receiving scores less than this 


may be classed as failures, and individuals receiving | 


scores greater than this classed as successful. Now if we 
have a normal distribution of scores it is impossible to 
choose a satisfactory critical score because we know our 
examination or test does not measure accurately enough 
to enable us to make the required fine discrimination. If 
we fix 40% as the passing mark, for example, how shall 
we classify an individual who receives a mark of 39%, 
or since in some cases an even finer marking classification 
is used, a mark of 39.9%? With a bimodal distribution, 
on the other hand, we can easily determine such a critical 
score by choosing a point which lies in the range where 
the two component distributions overlap—it would be 
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better if they didn’t overlap at all, but this may be too 
much to hope for. Clearly what we wish to do in this 
case is devise a test which gives a bimodal distribution 
of scores with the critical score at some point we fix in 
advance, or possibly with a critical score such that a 
certain percentage of the individuals fall in one or other 
of the two distributions. With such a distribution of 
scores, it is a simple matter to make the required classi- 
fication of the individuals. 

Let us consider next some of the various types of dis- 
crimination we may wish to achieve, and the form of the 
corresponding distributions of test scores. 





1. Discrimination between groups of individuals 


t In educational work, guidance, type psychology, etc., 
' very frequently we wish to discriminate between groups 
of individuals rather than between the individuals within 
the groups. The problem discussed in the previous para- 
_ graph falls in this category, for instance, and there are 
-| numerous others. There are certain special problems in 
this group in which we wish to maximize the difference 
between the groups and minimize the differences between 
the individuals within the groups, but this is an added 
refinement which need not be discussed here. It may be 
noted in passing, however, that for this special purpose 
we want a U-shaped distribution of scores, i.e., scores 
piled up at the two ends of the scale with relatively few, 
or if possible none, of the scores falling near the middle 
of the scale. Although this type of a distribution is as 
unlike the normal as it is possible to imagine, obviously 
it is exactly what we want in such problems. 
. In many problems, however, we wish to do two things: 
n distinguish between the groups and also, as far as pos- 
1, sible, between the individuals within the groups. This 
11 makes the problem more difficult as the two purposes 
e are opposed to each other, but a test yielding a bimodal 
e distribution of scores is the type we want. The farther 
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apart the two component distributions are on the scale 7 
the better will be the discrimination between the groups, © 
and the greater the standard deviation within the com- | 
ponent distributions the better the discrimination within © 
the groups. By weighting these two factors according to | 
the demands of the problem, we should be able to obtain © 
a distribution, bimodal in form, of the scores which will | 





aig et 


give satisfactory discrimination. A test of this kind might | 


be very useful, for example, in picking out children to | 


be admitted to auxiliary classes. 


2. Discrimination wtthin a group of individuals 


The other kind of problems relates only to discrim- | 
ination between the individuals within a group. Here | 


again, however, there are several types of discrimination 


a 





we may wish to achieve. In these as in the previous cases, | 
we must define the type of discrimination we want and 


then construct the test in such a way that exactly this 

type is achieved. We shall consider three main types in 

the following discussion. 

(a) Equal discrimination at all points on the scale 

In this type, we wish to discriminate between 

the individuals equally well at all points on the scale. 
We wish to have, therefore, a platykurtic or, if pos- 
sible, a rectangular distribution of scores, since the 
purpose in this case is to discriminate between any 
subject and those near him on the scale. As this does 
not sacrifice the discrimination at any one part of 
the scale in favor of other parts, it will give us 
roughly equal discrimination at all points. It is 
likely that this particular type of discrimination is 
the kind generally desired, but of course each prob- 
lem must be treated according to its own conditions 
and hence such a general conclusion may not be 
justified. 

(b) Greatest discrimination at one end of the scale 

In problems of this kind we are interested in 
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achieving fine discrimination at one end of the scale, 
and to achieve this are willing to sacrifice the 
discrimination at all other points. In picking out 
scholarship candidates, for example, we want par- 
ticularly fine discrimination at the upper end of the 
scale, but we are not even mildly interested in the 
discrimination at other points. For this purpose we 
want what is called a J-shaped (skewed) distribu- 
tion of scores, i.e., a distribution with most of the 
scores piled up at the lower end of the scale and 
the rest spread out in the long tail of the distribution 
over the rest of the scale. Obviously, this gives us 
fine discrimination exactly where we want it. 

We may want fine discrimination at the other, 
i.e., the lower end of the scale in some problems. 
This may also be achieved, but here we want a 
J-shaped distribution of the scores with most of the 
scores piled up at the upper end of the scale, and the 
others scattered over the rest of the scale. This kind 
of a distribution gives us fine discrimination at the 
lower end of the scale, where we want it, and prac- 
tically no discrimination over the rest of the scale. 


(c) Greatest discrimination at both ends of the scale 


Sometimes we want fine discrimination at both 
ends of the scale, and are willing to sacrifice the dis- 
crimination near the middle of the scale and for the 
majority of the individuals. In such problems it is 
clear that we want most of the scores concentrated 
near the middle of the scale, with some spread out 
over both the lower and upper ends of the scale. This 
is the type of discrimination we achieve when the 
scores are approximately normally distributed. We 
obtain better discrimination at both ends, however, 
if we arrange the test so that the distribution is lepto- 
kurtic (i 2., peaked) in form, with long tails extend- 
ing towards both ends of the scale. 
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We may want other types of discrimination in some 
problems, such as combinations of the types discussed 
above. These possibilities need not concern us here, how- 
ever, as we have covered the main types of discrimination 
required. 

The discussion so far has been theoretical in nature, 
and the reader may well ask whether or not we can con- 
struct tests giving these peculiar distributions of scores. 
The answer is in the affirmative, but there are certain 
limitations. In the first place we must have valid items, 
i.e., items which discriminate as required, in our test. 
These can be constructed. Secondly, the items do not cut 
or discriminate clearly and hence we have a “blurring” in 
the distribution of scores. These are difficulties in test 





construction, however, and we can, by proper choice of | 
items, reduce the influence of these factors to a minimum. | 


_ ge 
ure 
_ of 
aid 


In this as in other fields we can never get exactly what 
we want, but we can generally obtain an approximation 
to it which gives results satisfactory for most practical 
purposes. 

It is going to be rather difficult for statisticians if tests 
yielding such peculiar distributions of scores ever come 
into general use. Most of their theory, tests of significance, 
etc., are based on the assumption of a normal distri- 
bution of the variables and could not be directly applied 
in cases such as we have considered above. This is the 
statistician’s headache, however, and is of minor impor- 
tance. We want tests to do specific jobs, and, if we can 
succeed in constructing tests which do this satisfactorily, 
we have solved our problem. The amount of work and 
trouble this gives others need not concern us if we know 
what we require and can get it. 
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TESTING IN MUSICAL EDUCATION 


ROY C. WOODS 
Marshall College, Huntington, W. Va. 
and 
LUREATA ROSS MARTIN 
Public Schools, Cabell County, Huntington, W. Va. 


_ the first wave of enthusiasm for testing had 
passed and its numerous proponents had realized 


_ that there were more significant things to be tested than 
_ memorized facts, it is not surprising that a variety of in- 
_ genious devices should have been developed for the meas- 
_ urement of these more subtle factors. In time the teachers 
_ of music became interested in this field of research and, 


aided by other specialists, developed a variety of devices 
for use in the measurement of music knowledge and abil- 
ity. To date but little has been accomplished in the field 
of measuring musical appreciation. A rich field awaits 
someone skilled in music and trained in testing techniques 
who will attack this problem and carry through the neces- 
sary research for the development of a valid measuring 
instrument. 


Writing as late as 1936, Gildersleeve’ stated that: 


Musical performance is the common test of musical, achievement. Private 
teachers present their pupils in recital. Schools give demonstrations, con- 
certs, and operettas. Largely from these, parents, patrons, and the public 
estimate the worth of music teaching. Through interschool festivals and 
contests, administrators, teachers, and pupils compare their own per- 
formances with those of other groups and thereby gradually evolve stand- 
ards of excellence in achievement of musical performance. 


Judging the educational value of music by group performance is not 
adequate. Other things being equal, it may be a fair assumption that the 


*Glenn Gildersleeve, Thirty-fifth Yearbook, Part II. National Society for the 
Study of Education, (Bloomington, Illinois: Public School Publishing Co. 1936.) 
Pages 195, 205. 
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finer the performance, the better the teaching, but that may not alway: | 


hold true... . 


Since the general social standard for evaluating musica] achievement is | 


inadequate, where then shall we direct the attention of parents? 


Having thus stated the problem he continues with an/ 


outlined program for testing music designed to give a 


cross section of music teaching. Concerning good tests in| 


music he says that: 





1. Good music tests should be interesting and attrac.| 


tive. 


2. They should duplicate the learning process and) 
induce a musical response. ; 


3. They should be short enough so as not to cause! 
fatigue. 
4. They should be easy to score, so as to take a mini- 
mum of the teacher’s time. 
They should be based on what has been taught. 
They should be impartial and objective, so as to 
eliminate the personal bias of the person giving 
the tests. 
Kwalwasser® is enthusiastic about the contributions 
that techniques of testing may make to the field of music 
education. He says: 


The new movement which is likely to elevate music from its lowly 
estate, and win for it its belated recognition, involves the scientific study 
of the problems of music education. . . . Applied to music education, i 
concerns itself with the learning process, methodology, analysis of talent, 
problems of administration, standards of accomplishment, etc. 


Many progressive supervisors are beginning to question the adequacy 
their procedures, materials, and objectives. . . . They believe that thew 
processes if evaluated by rigorous measuring devices will enable us ti 
improve the present status of music education. .. . 


It is fair to say that music supervisors do not know what their childre 
are achieving. . . . The entire field of music is open to investigation. 


a 


In another reference the same author?’ writes: 


Probably the newest and most promising movement in the field of musi 
education is that of tests and measurement. The last ten years have wit: 
nessed a phenomenal development in both the number and type of test 


* Jacob Kwalwasser, Problems in Public School Music. (New York: M. Wit 
mark and Sons. 1932.) pp. 129-135. 

*Jacob Kwalwasser, Tests and Measurements in Music. (Boston: C. ( 
Birchard and Co., 1927.) Pages vii, ix. 


30 





Cy rn oe see 


il 


as 




































TESTING IN MUSICAL EDUCATION 


that have been devised. The earliest tests were innate capacity measures. 


= : These were followed by learning tests, which measured knowledge of ele- 
- mentary theory and staff notation, primarily. . . . Music tests are (now) 

ts both diagnostic and prognostic in function... . 

- And Dykema‘ adds by saying that: 

- All students of education who believe music to be an important educa- 

as tional force should be interested in the extension to that subject of the 
in! test and measurement movement if for no other reason than the safe 


guarding of music teaching. 
Aptitude tests in music, according to Kwalwasser,® 
ic-| “measure elemental capacities. These capacities are 
' innate. They constitute one’s musical heritage. The tests 
nd measure objectively the amount of talent the individual 
' possesses. .. . They measure many specific musical ca- 
18¢| _pacities, which when combined with many other factors 
_| constitute musicianship.” 
- According to him® such tests would have the follow- 
ing five values in music education: 





‘ 1. Aptitude tests may be used for the discovery of 

he: talent hitherto unrecognized and undeveloped.... 

ne 2. The tests show the magnitude of individual dif- 
ferences. ... 

= 3. Aptitude tests reveal deficiencies that may or may 


not be suspected... . 
4. Aptitude tests sometimes reveal ear defects that 


_ may need immediate medical attention. .. . 
n, i 5. The tests may aid the pupil in selecting an instru- 
lent, 


ment (upon which to learn). 


y He further lists two values to the teachers of music, 
st a8 shown by the following quotation: 


Aptitude testing may aid the teacher in adapting the training to the 
ldre needs and nature of the child. The teacher cannot create talent when it 
does not exist, but can only utilize it when it is found. In order to teach 
the child successfully, the teacher is obliged to discover the child’s pro- 
ficiencies and deficiencies. The shortest and easiest method of talent 
analysis is aptitude testing. 


nusi 
wit Aptitude testing may be employed by the teacher as an aid in evaluating 
test the quality of a pupil’s work. A superior child may be inferior in accom- 
plishment even though he earns more than the average of the class. We 
we 
“Tbid, page ix. 
— "Ibid, page 1. 


* Kwalwasser, op. cit., pages 14, 15. 
. $l 
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do not require enough work out of our superior pupils. Our courses of 
study are usually designed to meet the needs of the mediocre pupils and 
the superior child excels his mediocre classmates by putting forth very 
little effort. The superior child should be impressed with the fact that 
superior talent carries with it obligation of superior attainments. Unless 
the teacher knows the quality of the child’s musical endowment, it is not 
possible to evaluate the work that the child is doing. Mediocre accom- 
plishment need not mean mediocre talent. Remember that the superior 


OE EN 


child is usually the retarded child. Testing will reveal what you may 


reasonably expect the child to do. 


At a much earlier period, Seashore’ stated that a test- 
ing program based on scientific procedures would be the | 
means by which musical talent might be found. For | 
said he: 


This will secure a sort of “drag-net” survey of musical talents, as all the 
children in the community will be reached when they pass through these 
elementary grades. It will stimulate an interest in the search for talent 
and efforts in the conservation of talent on the part of all concerned, 
particularly teachers. Among the pupils it will cause a wholesome awaken- 
ing to a recognition of their particular talents. For teachers of music it 
will stimulate the recognition of responsibility for the talented children 


ray 


of the community. It will be a part of the coming system of vocational ~ 
and avocational advice and should be a potent instrument in the develop- © 


ment of community interest in music. The tests themselves constitute 
very profitable musical exercises. 


Referring to one of these dragnet surveys in another 
reference, Seashore® maintains that: 


In all cases the first step should be the measurement of basic capacities, 
each of which measures receptivity for one of the four musical avenues, 
namely the tonal, the dynamic, the temporal, and the qualitative. In addi- 
tion to these, immediate memory, a sense of consonance, tonal memory, 
and intelligence should be measured. . . . Measurement deals with a 
specific factor which is isolable under control. This is the first principle 
of pure psychology. For example, instead of asking the question, “Can this 
child hear music?” we ask “Can he hear pitch?” “Can he hear loudness?” 
“Can he hear time?” “Can he hear timbre?” “Can he hear rhythm?” 
“Can he hear tone quality?” Each of these can be isolated for measure- 
ment; and, when we have the result, it is recordable, repeatable, verifiable, 
and predictive. What is true of hearing has its parallel on the side of 
performance as represented by skills. We do not ask, “Can he play?” but 
we ask, “Can he play a tune in time and in rhythm?” “Can he phrase?” 
“Can he produce good tone quality?” Such questions have their parallels 
at the higher levels of imagination, memory, thought, and feeling; although 
the higher and, therefore, the more complicated the process becomes, the 
more it tends to resist analysis. 


"Carl E. Seashore, The Psychology of Musical Talent. (New York: Silver, 
Burdett and Co. 1919.) Page viii. 

* Ibid, pp. 302-304. 

*Carl E. Seashore, Psychology of Music. (New York: McGraw-Hill. 1938.) 
Pages 302-304. 
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° When George Eastman, of the Eastman School of 
: Music, asked Seashore if there was not “something more 
ess _ possible” from such a testing program in the 
| field of music, Seashore® replied: 


4 That is the great future of talent selection. When a music psychologist 
ay fi is placed in the public school system with the sole charge of attempting 

s to discover, analyze, and certify talent which may be discovered by drag- 
net tests, analyzed by case histories, and verified by auditions, we shall 


“B 
‘ 
SEI 


t- be doing the positive thing in the public schools. We can then not only 

° inform the talented of their valuable possession, but we can give them 
ne § privileges in the public school musical activities in proportion to their 
or : capacities for achievement, and, as a result of their achievement and in 


the light of talent analysis, these pupils may be recommended to the best 
music schools. 


the | Larson?® outlines a musical testing activity program 
“t | Which is diagnostic, prognostic, and dynamic in charac- 


ed, | ter, similar in nature to the one suggested by Seashore to 
"i. Eastman. Since she was a pioneer in this field, her sug- 
se ' gestions carry added weight. In a slightly condensed 
op- _ and modified form, her suggestions as to the advantages 


ute of such a testing program are as follows: 


1. It enables the school system to place to best advan- 
tage the musical instruments at its disposal. 

2. It enables the school directors and supervisors of 
music to advise parents wisely in the purchase of 

di- instruments. 


er 


¥ 3. It makes possible a wise segregation of pupils into 
- classes according to ability, for, as she says, con- 
$?” trary to ideas that many have had on the subject, 
it has been demonstrated that there is more incen- 
ble, tive for the majority to work at their highest level 
< when they are in a homogeneous group. 

+t 4. It enables close study of those children who are 
ugh supposed to have unusual ability. 

& 5. It gives a better check on accomplishment of both 

teaching and learning. 
7" 6. There are a number of agencies and organiza- 


tions whose purpose is to help deserving pupils. 


*Seashore, ibid, page 323. 
* Seashore, ibid, page 323. 
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These tests will help get the maximum from the 
services of these groups. 

Since instrumental classes are expensive the test- 
ing program makes possible a wise limitation of 
those pupils who ask to be admitted to them. 


She suggests further that these advantages also) 
accrue to classes in group singing and are not lim. © 


ited only to instrumental groups. 


Recognizing the limitations in the field of testing in 
music education, Dykema" writes that: 


Great caution must be exercised in interpreting the results of even legiti- 


mate tests. Music involves facts, skills, and emotional or spiritual expres- © 


sion. The first can be adequately measured, the second partially measured, 


and the third as yet, probably not at all. .. . We may well emphasize | 


some of the more distinct values of using wisely the tests which are now 
available. They give, first of all, an impersonal measurement. . . . Second, 
they give a reliable measure of progress by using exactly the same material 
and method of procedure in the regular class work both for teaching 


along lines already established, and for undertaking new work. . . ./ 
Fourth, they offer a means of presenting to administrative officers a con- | 
crete formulation of results which even the non-musical superintendent | 
can understand. .. . Fifth, they are a spur to the children (for) definite © 


measurement is attractive to all students... . 


That testing in the field of music education is a far 
from satisfactory solution is also recognized by Gilder-| 
sleeve’? when he suggests that: 


There are three serious limitations of teachers in the use of tests. The 
first limitation is . . . the wrong conception of the purposes of testing © 
held by too many teachers. Understanding the real value of tests as in- © 


dividualized classroom drills will do much toward removing this limitation. 


A second limitation lies in the inability of many music teachers to interpret 
the results of a test they have given and to show the results to a class in 
simple graphical way. . . . The science of testing is of little value to the 
teacher who does not understand it. 


A third and serious limitation is found in the incompetence of music 


teachers in constructing homemade tests and drills. Tests and drills should © 
be musical and interesting, they should function with each pupil, and they ~ 


should emphasize only those things that are essential. 


The ultimate of musical-achievement testing. as well as music teaching, 


is shown by emphasis upon the essentials for growth in music and upon” 
music as contributory to sanely balanced, emotionally adjusted living © 
Attitudes, emotional reactions, and technical skills develop simultaneously. ~ 
The types of tests suggested . . . will assist in appraising changes resulting — 


from our teaching in all three of these aspects of learning. 


™ Kwalwasser, Test and Measurements in Music. Page xi. 
* Gildersleeve, op. cit., page 206. 
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Throughout all these statements runs an implication 
of another valuable contribution which testing techniques 
may make to the field of music education. As shown 
by quotations already made, an adequate program of 
musical instruction is dependent upon the knowledge 
of the factors constituting musical talent. After these 
factors and talents are known, and only then, can a 
good program be developed for the cultivation of 
these talents. Illustrative of this use of testing de- 
vices is the investigation made by Martin, who used 
these techniques for research purposes. She used the 
Kwalwasser-Dykema Music Ability Tests, which con- 


| sist of five records with a single test on each side measur- 
_ ing some phase of musical talent. The first of these ten 


tests test the native capacity for tonal memory. It tests 
the pupil’s power to retain and compare patterns of tones 
of varying durations. It consists of twenty-five paired 
patterns, which begin with four tones and end with nine 
tones each. The pupil is permitted to hear each pair of 
tones once, and he determines from the single hearing 
which of the patterns are similar and which are different. 
In a similar manner tests were devised to measure the 
pupil’s ability to discriminate quality and intensity. 
As the tests grow more complex they test the pupil’s 
ability to judge the tendency of a succession of tones to 
proceed to a point of rest. Time discrimination, rhythm, 
pitch, melodic taste, pitch imagery, and rhythmic im- 
agery are also measured objectively by these record de- 
vices. In these tests discrimination is interpreted as the 
pupil’s ability to recognize. Imagery deals with a more 
subtle factor, which is the pupil’s ability to reproduce 


_ the image. They compare favorably with our recogni- 


r- _ tion and recall types of general objective tests. The man- 


ual which goes with the test records gives a detailed 
description of the tests, their meaning, and the purposes 
for which each may be used. 
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Martin’ gave these tests to 578 pupils in the sixth” 
grades of Cabell County, West Virginia, during the | 


months of April and May in 1941. These pupils repre- 
sented a sampling from various types of communities so 


as to have pupils from communities that are predomi- | 


nantly Negro, industrial, business, professional, small 
town, large city, or rural. For comparative purposes 
they were grouped so that she could determine the ef.- 
fectiveness of the following factors: 


1. The racial factor was studied when the Negroes» 


were compared with the white children. 


2. The sex factor was studied when boys were com- | 


pared with the girls. 
3. Groupings were made so as to determine if the 


type of community in which the child lived con- | 


ditioned his music ability. 


4. Chronological age groupings were made to study © 


See 





general scholastic ability as shown by degrees of 


retardation in its relationship to music ability, | 


5. Previous experience was studied by comparing” 
the scores made by those who had had previous” 


musical training with those who had had none. 


Each of these factors probably deserves a paper by 
itself but space will permit only a brief treatment of each” 


in its turn. The accompanying table was compiled from 


the data given in Martin’s report of her investigation. Al- 
though the investigation was on a scope too limited for 
generalization both in numbers of cases involved and the 
geographical area covered, it seems that some conclusions 


can be drawn that have more than passing interest to us. | 


The race factor was really suggested by Seashore" 


when he stated that: 


*Lureata Ross Martin, Factors Affecting Musical Talent in the Sixth Grad 


Pupils of Cabell County, West Virginia. (Unpublished Master’s Thesis, Marshall 
College Library, 1941.) 


* Seashore, op. cit., page 309. 
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This type of measurement is suitable for anthropological studies and is 
likely to be enlarged and refined on a considerable scale. However, the 
present indications are that normal individuals in different cultural levels 
probably do not differ markedly in the basic capacities represented by 
these measures. 


MEDIAN TOTAL SCORES ON THE KWALWASSER-DYKEMA MUSIC 
ABILITY TESTS (From data presented by Martin) 











Number Median 
Items Cases Score 
EN Bnd ities acme uma Ga wekaanaes 106 186.27 
MT is ceate is N85 os oss ee A eotete k Cine e sR eae 106 177.06 
elt is sii chica tou aihitieaidin eae eolkale 288 175.89 
ass side here Soregis MeN 6d abe abe Rees eens 288 180.75 
REN Sea icra Rao wis beta wala eK d Siar wees 105 173.09 
Business and Professional* ..................2.. 105 186.33 
5 sig yo sieeve AP CGS Seo oie Whee ed Sine ais Gd 168 181.28 
ME A GtAicty. Ve ios So ciel wlan ack ew aia @c wie ears te.crumiate 168 170.0 
NINN NI ek 9 cos /siocs va vig Ridta es 6 Pe Soi sls Relea ee 74 173.58 
SN 205 oe: F055 ous iors shar0'g 6 4 215 wig Siaveie Oro alS SCs 74 179.5 
RIL oo acs oh 76' 5 6 6 ols aap bea Aas ba elie VaR 45 190.07 
RUEMERMENR 5-3. ¢lcrelsss 2 Suda a oraigw wivieieieweiere 266 181.3 
TU oo 5S 6'sid\ 4 60: t.0Od so oe wre wiecwlewe 152 174.0 
ee nnn 73 171.83 
BOM VERE-GIIS, oo o.cckscaccesoccsectccesces 31 167.3 
MMR INO go sf 15-5569 Gis 0.9.05 Bo 6 Sas Saw oes 10 171.5 
PE AUR oo 6.0 6.5-4.5 0 sie Se alee sce oi 123 183.75 
PNOUMOVAOUNS CIBITIT 9 65 66:65 a6 bcs oiee soe vias viee's 123 174.58 
RE SE Sree ere ee en me 165.65 





*Equated by random sampling. 


Using the Seashore Musical Tests, Lenoire made 


_ such a study in the fifth grade in 1925, which was re- 
_ ported by Kwalwasser.*® According to this source we 


learn that: 


. . . Aptitude tests were given to two hundred white children and two 
hundred colored fifth grade children (and that) . . . the negro was found 
far superior to the white child in rhythm and tonal memory, and not 
inferior in any of the other sensory capacities. The colored child averaged 
65.69 in rhythm, whereas the white child averaged 61.48. . . . Whether 
the negro maintains his superiority in rhythm and tonal memory in sub- 
sequent grades is a matter of speculation, for no study had been made... 
in the upper grades. 


The investigation by Martin threw some light on the 
question raised above since she confined her investigation 





* Kwalwasser, Test and Measurements in Music, page 12. Quoting from Zaid 
Lenoire, Racial Differences in Certain Mental and Educational Ability. (Thesis, 
_ University of Iowa Library, 1925.) 
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to the pupils in the sixth grade. She’® found that “the| 
Negroes were... superior to the white children in? 
rhythm and tonal memory, and not only in these two! 
items but superior on quality, discrimination, tonal move- | 


ments, melodic taste, and pitch imagery.” 

In studying the sex factor in musical talent, Martin" 
found that “girls showed a slight superiority over the 
boys in musical ability.” 

Seashore,** who found similar results, suggests that: 


The superiority of elementary school girls over elementary school boys, 
may probably be fully accounted for by the prevailing trait of aloofness | 


of the pre-adolescent boy toward music. These boys often regard music as 
a sort of frill for girls, and therefore enter the test with less fervor than do 


girls. Such interpretation is supported in part by the fact that in the high” 


school and in the university, where the girls have had far more advantage 
than the boys, the records reveal no appreciable difference for sex. 


He fails to find any significant difference between 





boys and girls in pitch discrimination, which he says 
“does not vary with sex to any significant extent.” 


Interesting data were found in the study of the type) 
of community factor. Martin stated’® that when she| 
started her investigation she “did not expect to find a) 
very great difference between the children of the indus-) 
trial sections of the county and the children of the busi-| 


ness and professional sections, since it is innate ability’ 





which is measured and not training or achievement.’” 
Her expectations were not sustained, for she states that” 
“the children from the business and professional section 


of the city were superior to those of the industrial group.” 
In a like manner she found” that the “urban children’ 
proved to have more talent than rural children... (and) ” 

the city children have more musical capacity than the 


small town group.” : 


§ 
is 





* Martin, op. cit., page 8. 

* Martin, op. cit., page 32. 

* Seashore, Psychology of Music Talent, pages 56-57 
* Martin, op. cit., page 47. 

» Martin, op. cit., pages 62, 74. 
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1€ : In speaking of age as a factor in the musical ability 


in} of children, Kwalwasser®! says: 
Oy Many think that musical talent is conditioned by age, but we are not 
e- justified in believing that age is either a help or a hindrance. Teachers 


of music frequently look with suspicion upon the tests, after they dis- 
cover that some children in their classes earn higher scores than they 
themselves do. But this revelation should not prejudice the teacher against 
aptitude testing. It is altogether possible that some children are poten- 
1e tially superior to their teachers in native endowment. ... [Yet he says 

there are factors which aid older children and he lists them as] better 
control of attention, increased power of application, better understand- 
ing of instructions, and better adaptation for sustained effort. Psychologists 


tie in music do not believe that younger children are inferior to older ones 
4 in their spontaneous perception of differences, but that younger children 

NYS, may be inferior to older ones in their mental habits. 

1655 

as The superiority which is frequently found existing 


ih) among older children when compared with younger ones 
“> may be due to the factor of experience in meeting situa- 
- tions which have elements in common with the situation in 
which the superiority is isolated for study. Bowers and 
‘YS Woods*” 7* 24 have shown that the intelligence scores 
_ made by freshman in college are affected by the experi- 
pe ence the freshmen had had in high school, involving ob- 
_ jective tests of similar nature. 
a' In the case of Martin’s investigation the age factor 
-_ took on additional significance. Here she limited herself 
si-| to sixth-grade pupils and, since the ages of these pupils 
ity! varied, it becomes an evidence of the relationship existing 
t.”" between success in school and musical talent. Stated an- 
at’ other way, it is a measure of the existing relationship 
on between musical talent and scholastic maturity or the 
.” pupils’ educational ages. She found” that: 
el E In every test, with the exception of pitch imagery and rhythm imagery, 





—_ 
oO 


_ 
_n 
pes 











7: 
d) Q ™ Kwalwasser, op. cit., pp. 4-6. 
he” *E. V. Bowers and Roy C. Woods, A Study of the Experiential Factor in 
| Objective Test Scores. Proceedings of the West Virginia Academy of Science at the 
_ Huntington meeting in 1937. Published by West Virginia University, Morgantown, 
W. Va. Series 38, No. 8, p. 148. 
: *E. V. Bowers and Roy C. Woods, “A Study of the Experiential Factor in 
: Intelligence Tests Scores,” Journal of Educational Research, XXXIV (1941), 509. 
_ * Roy C. Woods, A Study of the Factors of Experience and “Earmindedness” 
in Using Objective Tests. First Yearbook of the National Association of Teachers 
_ of Educational Measurements, 1941, page 1. 
* Martin, op. cit., page 86. 
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the ten-year-old group ranked higher than the older groups. These chil- | 
dren were accelerated for their grade level and it stands to reason that 


they had superior ability or they would not have been in the sixth grade, 
In the case of the thirteen- and fourteen-year-old groups who were aver- 
age for their grade level, the median scores showed their inferior ability 
or capacity for music. 


In the study of the factor of previous music training 
in its relationship to music ability as measured by these 


tests, grave questions could be raised relative to the ques. | 


tion whether or not the tests really measured innate 
ability. If the tests as designed by Kwalwasser really 


measured native ability in music the previous training or” 


the lack of previous training which the pupils had had 


would have had no influence on the resulting test scores. | 


On this point Kwalwasser”® says: 


By actual experimentation it has been demonstrated that training cannot |) 
improve one’s musical endowment. . . . Training is incapable of giving an | 
individual more talent; it merely utilizes the talent that the individual | 


possesses. . . . Training will not eradicate innate musical differences. On 
the contrary, training is more likely to magnify these differences. The 


individual who is more generously endowed with musical talent is likely” 
to realize a great deal more, proportionately, than the individual of — 
meager endowment with the same educational opportunities. This is a 


truism that many teachers fail to recognize. 


In this conclusion Kwalwasser is supported by the” 
majority of authorities in the field of psychology, but the! 
data collected by Martin failed to substantiate this con-_ 
clusion. It may be that the tests designed by Kwal-| 
wasser failed to fully control the factor of previous’ 
learning. In that case the tests in part at least measure 
achievement as well as ability in music. Any one familiar’ 


with the problems of ability testing will have no difficulty 
in accepting the latter possibility. Martin?’ found that 
“the total median score for the children who had had 
outside training was higher than for those who had not 
had that extra training.” She adds that this may be due 
to the fact that “the number of pupils (she) tested was 


not significant in comparison with the number which’ 


Kwalwasser used to arrive at his norms.” She shows that 
the average score for those with previous training was 





*® Kwalwasser, op. cit., pages 2, 4. 
** Martin, op. cit., page 87. 
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i | 183.75 and those without such training was 174.58. The 


de. +Kwalwasser norm is 165.65. 
ity One must add that the assumption that previous train- 
ing has no bearing is further damaged when we take into 
1g account the fact that Cabell County, West Virginia, has 
sé an excellent program of musical training, which is especi- 
s- | ally true for the cities, the largest one having the best in 
t¢| the county. This could easily account for the fact that 
ly} in each case the norms found by Martin were higher 
or than those given by Kwalwasser for the tests. The group 
ad) having had previous training topped them all and the 
es. | larger communities had superiority over the smaller ones. 

' In conclusion, this paper has attempted to show: 
not! First, the value and use of musical tests in an educa- 
uj) tional program. 
Second, The dearth of suitable devices for testing in 
ey! this field warrants more emphasis on the future develop- 
.“| ment of measuring devices. 

_ Third, In so far as we can draw conclusions from one 
he’ small survey of musical talent we can conclude that: 





he! 1. The Negroes are superior to the white children 
mn | in musical ability. They averaged a score of 
al-| 186.27, while the white children averaged 177.06. 
US | 2. The girls in the elementary school are superior to 
ire | the boys at that level since the girls averaged 
ar 180.75 and the boys averaged only 175.89. 

Ity 3. The types of communities in which the children 
iat lived seemed to have a direct bearing upon the 
ad scores the children made on this test. Either some 
Lot sociological factor operated as an environmental 
ue influence or the children whose parents were in- 
vas inclined to innate musical ability had tended to 
ch migrate to the better communities in which to 
rat raise their children. This is best shown by the 
vas following summary: 


a) Children from the business and professional 
sections had an average score of 186.33. 
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b) Those from the largest city averaged a score 
181.28. ; 

c) The small town group of children averaged a | 
score of 173.58 on this test. 

d) The children from the industrial section of © 
the county averaged 173.09. (It might be well 
to indicate here that the small cities in this 
county are in reality industrial centers, workers 
having moved there because of the low rents; © 
in each case one industrial concern is located © 
there, too.) 

e) The rural sections averaged 170.0. 
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. The children most retarded in school showed the 
poorest results from taking the test. Those who | 
were accelerated in school work showed superi- | s 
ority in musical ability. This is shown by the fol- | \ 


lowing summary of data: s 
a) Ten-year-old children in the sixth grade av- © 
eraged a score of 190.7. 

b) Eleven-year-old children averaged a score of © 
181.3. 

c) Twelve-year-old children averaged a score of | 
174.9. 

d) Thirteen-year-old children averaged a score 
of 171.83. 

e) Fourteen-year-old children averaged a score 
of 167.3. 

f) Fifteen-year-old children averaged a score of 
171.5. (It is pertinent to add that there were 
only ten cases of fifteen-year-olds, which may © 
account for the change in trend.) : 

. Children who had had previous training in music © 

averaged a score of 183.75, while those who had 

been deprived of this privilege averaged only © 

174.58. Either previous training did condition the © 

ability for music measured by this test or the test ‘ 

also measures musical achievement to some degree. © 
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SCHOOL AND SEX DIFFERENCES IN 
AFFECTIVE TOLERANCE 


ROBERT I. WATSON 
United States Naval Reserve 


[* THE development of a new inventory it is impera- 
tive to present normative data from various schools and 
from both sexes. It is the intention of the writer to de- 
scribe some school and sex differences in scores on the 
Watson-Fisher Inventory of Affective Tolerance. 

Since this inventory is described in detail in a previ- 
ous article (7) only a brief resumé seems necessary. Affec- 
tive tolerance is the capacity to deal with affective ten- 
sions Or emotional excitements. The sheer capacity to 
withstand or to “take” emotional disturbance is its most 
basic aspect. In addition, there are at least two other 
capacities which make relative this affective endurance. 
These are the individual’s ability to vent or to discharge 
his affective tension, and his ability to give a subjectively 
appropriate form and direction to his release of tension. 
Affective tolerance including these aspects is measured 
by this inventory. Higher scores represent greater tol- 
erance. 

Scores of forty-five boys and forty-five girls were 
available from each of six colleges and universities. All 
were native white students drawn from the four academic 
years with a somewhat greater proportion from the first 
two years. Two of the schools were state universities in 


| the Rocky Mountain area, one was a state university on 


the west coast, and another a state university in the south- 


P western portion of the United States. Two private col- 
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leges, one on the eastern seaboard, and the other in the 
middle-western area, completed the group of six schools 


Table 1 gives the means and standard deviations of | 


the scores of the various school groups for the two sexes. 


TABLE 1 
SCORES ON THE INVENTORY OF AFFECTIVE TOLERANCE 
ACCORDING TO SEX AND SCHOOL 





























Males Females 

School N M o N M oe 
D oeraadiounivarei ade 48 68.72 27.61 45 50.72 280) | 
SRR RITIRRG ties 45 84.72 31.31 45 71.61 2589) 
Dah eck asian 45 73.60 29.32 45 71.39 26.87 

Ris espucwacamiabnnds 45 81.39 26.04 45 7850 26.207 
“ENCES 45 82.72 36.53 45 68.06 2935) | 
ey sly nck vati 45 90.05 31.23 45 7850 26.70) 
ME GAD ....ninscnnasss 270 80.20 33.04 270 69.80 2881, - 
f 
The individual school means for the males range from . 
68.72 to 90.05, with a mean for the total group of 80.20.) " 
The means for the females range from 50.72 to 78.50,| d 

with a mean for all girls of 69.80. 

The question arises as to whether these differences 
in means for the various schools and the two sexes are’ 7 
indicative of real differences or whether they can be c 
explained in terms of chance fluctuation in random sam-| v 
pling. Analysis of variance seems an appropriate method 1 
of testing the significance of these differences. aS 
Table 2 presents data on the estimates of population _ tt 
variance for school differences for male and female col- n 
lege students, respectively. The estimate of variance based $ 
, 7S 

TABLE 2 
ESTIMATES OF POPULATION VARIANCE FOR SCHOOL DIFFERENCES  . 
IN SCORES ON THE INVENTORY OF AFFECTIVE TOLERANCE AMONG 12 
MALE AND FEMALE COLLEGE STUDENTS ola 
er 
ve Sum of Squares Estimate of Variame 
Senin ot entation a Males Females Males Female th 
ere 5 13922 23460 2784 4692 OU 
Within groups ........... 264 167044 202091 632 766 of 
C1. OR ee ee a 269 180966 225551 'T, 
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yn¢_ 12 mean score although not among all schools. No specu- 
_ lations will be offered as to what accounts for these differ- 
ences. It is the purpose of the writer merely to establish 


_ the existence of such differences. These differences bring \ %* 
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on the school means when divided by the estimate of av- 
erage variance within the school groups yields F ratios 
of 4.41 and 6.13, respectively, for the male and female 
subjects. With 5 df for schools and 264 df for “within 
groups,” F of 3.10 is necessary for significance at the one 
per cent level. It is apparent, then, that one can be highly 
confident that the null hypothesis is false and that real 
school differences do exist. 

This does not, of course, show that all school differ- 
ences are significant. The ¢ test is an appropriate method 
of determining the significance of the specific school 
differences. The estimated standard error of a difference 


| between any two school means is 5.12 for the males and 
5.82 for the females. For 264 df, t must exceed 2.576 





for significance at the 1 per cent level. The difference 
| between schools must exceed 13.19 in the case of the 
_ male subjects and 14.89 in the case of the female stu- 


M:1-Me2 

dents as found by substitution in the formula t = 
’ o 

M 


a2 


_ The only differences which are significant at the 1 per 
cent level for the girls are those between School 1, in 
-| which the mean is smaller, and the remaining five schools. 
' The school differences in the boys’ scores also show 
- School 1 as having a significantly lower mean score than 
_ the other schools, except School 3, the mean of which is 


_ non-significantly different from that of School 1. In turn, 
School 3 has a mean score significantly smaller than 


; School 6. 


It is apparent, then, that school differences do exist 


out quite clearly the advisability of the establishment 
of local norms when using this and similar inventories. | 





Too frequently there is undue and unthinking depend- “ 
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ence upon the norms accompanying a test. Although it! 
is the intention of the writer to furnish norms with the 
published inventory,’ school differences make advisabley 
some consideration of this matter. 


Sex differences were also investigated by the snails ¢ 
of variance. Table 3 presents estimates of population! ‘ 
TABLE 3 


ESTIMATES OF POPULATION VARIANCE FOR SEX DIFFERENCES IN 
SCORES ON THE INVENTORY OF AFFECTIVE TOLERANCE AMON 

















COLLEGE STUDENTS " it 
: : n 
—_ Sum of Estimate | 

Source of variation df Squares of Varienss : 4 

OR i 1 14601 14601 | I 

iat asses eam iaets 5 32380 6476 Fe 
Sex x Schools (Interaction).......... 5 4664 933 
ETS Re ee ry ee 528 369135 699 

Se EET Te 539 420780 | 0 

a 

1S 


variance for sex differences in scores on the inventory! 
using the same college students. The kinds of variance! 
investigated are sex, schools, sex X schools and error 
variance. The latter includes variance between subjects) ( 
the interaction between sex and subjects, the interaction) Bb 
between subjects and schools, and the interaction among] ‘“ 


sex, subjects, and schools. These data on population vari-/ on 


ni 














vl 
TABLE 4 : 
THE F RATIOS BASED ON DIFFERENCES IN SCORES ON THE 
INVENTORY OF AFFECTIVE TOLERANCE AMONG s 
COLLEGE STUDENTS Ww 
Necessary for Necessary for ba 
Source of Variation F Significance Significance | €N 
at1% Level at5%Levd) ~ 
Sex X Schools + Error ........... 1.32 3.06 2.23 th 
NINE cach naw nies dawns sos’ 20.76 6.69 3.86 § 
Sen > Sex X Scheels ............ 15.65 16.26 6.61 | ar 
oO Sey 2 eee 9.26 3.06 2.23 






Schools + Sex X Schools ......... : 10.97 5.05 












*To appear shortly through the Sheridan Supply Co., Beverly Hills, California)’ er 
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ance allow for the calculation of F ratios to test the sig- 
the | nificance of the differences in the estimates of variance. 
ble! Table 4 presents these F ratios. 

_ The first of these concerns the variances of Sex X 
Si") Schools + Error. The ratio obtained is non-significant 
100/ since 3.06 is necessary for significance at the 1 per cent 

" level. Indeed, the difference is not significant at the 5 per 

~ cent level, since 2.23 is necessary at this point. The sex X 
schools or interaction variance is an error estimate, as 
is also the one labeled as error variance. The non-sig- 
=! nificance of the difference found shows that there is only 
ane! a chance difference between the two error estimates. 
1 | Therefore it is possible to use either as an estimate of 
6 | error variance. 

9 | In view of the statistical non-significance of this previ- 
ous difference, it is appropriate to test Sex variance 
against Error variance. The ratio found is 20.76, which 
is highly significant, since only 6.69 is necessary at the 
Ory! one per cent level. Sex differences exist, and boys in gen- 
net” eral show greater effective tolerance. This, however, does 
Tot! not take into account school differences. 

Ct‘ The F ratios for Sex + Sex X Schools is 15.65, just 
- barely not significant at the | per cent level, since 16.26 is 





" Necessary. The ratio found considerably exceeds the one 
atl’ necessary at the 5 per cent level, since this value is 6.61. 
_ It is apparent that with school differences eliminated sex 
_ differences are still significant. 
_ In passing, it may be mentioned that school differences 
_ previously described are confirmed in that the F ratio 
“a based on Schools ~ Error is 9.26 , indicating a real differ- 
ance |, ence between schools. When the ratio between Schools 
“—* Sex X Schools is derived, it is found to be significant at 
} | the 5 per cent level, indicating that when sex differences 
| | are eliminated there is still a difference between schools. 
-  Inconclusion, it would appear that: 


1. School differences in scores on the Affective Tol- 
rance Inventory exist. Not all the schools concerned in 
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this study are significantly different in mean score, but 
in general such differences are established. 

2. Sex differences in favor of the greater tolerance) 
of the males is found irrespective of school. , 
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A THEORY OF VOCATIONAL INTERESTS AS 
DYNAMIC PHENOMENA’ 


EDWARD S. BORDIN 
University of Minnesota 


Since 1919, when Strong, Fryer, and his associates 


| first began to struggle with the problem of their measure- 


ment (9, p. 60), vocational interests and aspirations have 
become accepted as important phenomena in the field 
of human behavior—phenomena which must be consid- 


ered if we are to understand certain broad areas of hu- 


man behavior. It can be observed that the vocational 


mainsprings of his action. The manner in which this 
phenomenon pervades all phases of human life may be 
illustrated in the observation that the young boy has 
already begun to focus his thinking in this direction as he 
goes through the stages of wanting to be a fireman or a 


_ railroad engineer. As an early adolescent he may think 


_ of himself as a professional baseball player. Still later, 





as the values and goals of adult thinking begin to take 
hold, he begins to formulate goals which he may pursue 
in his remaining lifetime. It seems axiomatic that any 
psychological thought which fails to consider this phe- 
nomenon necessarily abandons one of the rich sources of 
knowledge about human action. 


This paper attempts to present a theory of the nature 


_ of vocational interest phenomena. The form of the phe- 


C—Tr—CC 







*This theory forms part of the background for the research program on the 


~ clinical applications of the Strong Vocational Interest Blank in progress at the 


University Testing Bureau, University of Minnesota. 
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Strong Vocational Interest test (14). At this point in the! 





development of the theory there are two self-imposed) 


limitations. First, the writer is not yet ready to generalize) 
his theory in terms of the phenomena measured by other? 


so-called vocational interest tests. Such generalization) 


must await more complete knowledge of the interrela- 


tions of the various tests and the degree of identity of they 


behaviors. Second, there will be no immediate attempt 
to integrate this theory into some larger psychological! 
system, even though some of the relations may be appar- 
ent. In this discussion we shall confine ourselves to the) 
following: a presentation of our theory and the contrast 
between it and other theories, the discussion of the impli- 
cations of the theory for certain aspects of vocational 
interest test behavior, and the outlining of new experi- 
ments deducible from our theory and pointing to results 


which, in some cases, would not be deduced from other) 


theories. 


Comparison of Theories z 

Theories of vocational interest can and have taken) 
one of three directions: 1. The static point of view in 
its extreme form conceives of this phenomenon as some- 
how reflecting a fixed biological trait. In its less extreme/ 
expression, vocational interests are fixed after the indi- 
vidual has reached maturity. Usually, there is the idea) 


of maturation which, of course, carries the implication” 


of biological determinism. 2. The dynamic view secs} 


vocational interests as the product of a concatenation of” 


psychological influences and, as such, subject to change) 
with changes in the equilibrium. 3. The empirical view: 








nomenon on which the discussion will focus will be the? 
















which goes no further than to say that there are sets of 


preferences which can be shown to distinguish successful | 
men in various occupations from men in general. 

The last view is most descriptive of the view taken b 
Strong.’ Since actual use of the phenomenon would neces 


. Expressed in conversation with the writer. 
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sarily involve some assumption about its genesis and its 
implications for the future, this view does not provide a 
foundation for applications of the empirical facts. The 
applied worker is forced to make a choice between either 
of the first two views. As part of the empirical view the 
attempt is made to define the act of liking or disliking. 
Here, Fryer’s (5, pp. 348-350) early statement of the 
acceptance-rejection principle has been taken with little 
or no alteration. But the principle that individuals will 
accept or reject an activity depending on whether the 
activity is pleasant—therefore to be repeated or pro- 
longed—or is unpleasant—therefore to be avoided and 
eliminated—does not add much to our ability to encom- 
pass this acceptance-rejection type of behavior in a con- 
structive view of the problems of vocational satisfaction. 


For the broader problem of vocational satisfaction, 
either of the first two views is chosen as the basis for 
description and prediction. The static view of vocational 
interests as measured by the Strong test is well presented 
by Darley (5). After discussing theories of this phenom- 
enon as depending on achievement and as representing 
a final stage in a “recapitulation” process, he suggests that 
the most acceptable hypothesis would view vocational 
interests as by-products of the development of personality 
types. It must be remembered that in speaking of voca- 
tional interests, Darley makes use of the concept of in- 
terest types*® which had grown out of his own work and 





* Our discussion will make use of this concept, but the interest groupings will 
be those presented by Strong (14). The following are the descriptive terms which 
have been tentatively applied by the counselors at the University Testing Bureau 
to the groupings which contain more than one occupation. 


Groups Description 
bE Biological scientific 
II Physical scientific 
IV Sub-professional technical 
Vv Welfare 
VII Business detail 
VIII Business contact 


1B.4 Verbal 
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the factor analysis studies of Thurstone and Strong. The | 
treatment of interest type as a by-product of personality | 
may result in a static or dynamic theory. If by personality | 
we mean a pattern of behavior which is fixed within cer. © 
tain limits after the individual is fully matured, then the | 


theory is a static one. If by personality we mean the goal- ‘ 
: 







directed strivings of the individual, then we may con. 
sider such a theory a dynamic one. 

By his discussion of the personality theory of inter- 
est types, Darley indicates his leanings toward the static 
view. He emphasizes Strong’s summary statements about 
his studies of age changes in interest which draw atten 
tion to the continuity in interest patterns. Carter’s views 
are discussed with the interpretation, “The implication 
here is definitely that the pattern cannot be changed by 
occupational experiences, but will persist in spite of 
experiences basic to another pattern.” (5, p. 57.) Finally, 
after citing a study of a small sample of vocationally mal. | 
adjusted adults, he states, “It reinforces his (the clin-| 
ician’s) belief in the importance of interest measure 
ment, and it fits into the hypothesis of interests as an out- | 
growth of personality, since all of these cases had appar- © 
ently possessed enough ability and special training and © 
aptitude to get and hold jobs long enough to establish _ 
a model occupation.” (5, p. 58.) > 1 

Carter, although interpreted by Darley as holding a 1a 
static view of vocational interests, in the article quoted pl 
(2), actually presents a description of vocational interests _ is 
as dynamic phenomena. He points out that “In the de-_ hi 
velopment of vocational attitudes the young man or st 
woman is attempting a practical adjustment to environ 
mental conditions. In this adjustment the individual is — 1s 
limited by certain external realities such as are shown by _ Si. 
study of home environment, needs, personalities of  § 
parents and friends, and cultural resources available to — 
the individual.” (2, p. 185). 
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| He also states, however, that “The adjustment is also 
- limited by another class of realities outside the person’s 
' control, consisting of the individual’s own native equip- 
-| ment, physical traits, energy, mental ability, and so on.” 
' (2, p. 185.) That Carter believes that patterns, once es- 
-| tablished may still be supplanted by new patterns is indi- 
- cated by the following quotation from the same article: 
In the beginning, many of the interest patterns found among young 
people are very unsatisfactory solutions to their problems of adjustment. 
Attempts are made to make the solutions work, but frequently this is 
impossible. After disruption of the pattern, a new pattern is developed, 


and it may be a better one; if so it may last indefinitely, otherwise the 
process is repeated again. (Italics are ours.) (2, p. 186.) 


It is the writer’s belief that this view of vocational 
" interests can be refined and made more precise in such 
| amanner as to create a basis for a deductive system which 
- can account for all of the known phenomena about the 
Strong Blank and can successfully predict many as yet 
- unknown phenomena. The basic theory upon which these 
_ deductions would be based would be stated as follows: 
| In answering a Strong Vocational Interest test an indi- 
_ vidual is expressing his acceptance of a particular view or 
concept of himself in terms of occupational stereotypes. 
As Carter has suggested, this concept of the self is 
not something which appears full blown at some particu- 
a lar stage in the individual’s development as some purely 
d physiological trait might be expected to do. Rather, it 
ts is a resultant of a series of experiences in the individual’s 
e-| history which may find their focus at some early or late 
yt stage of development, depending upon the particular 
1- — combination of events. This point is clearly stated, “There 
is is no single chronological age at which persons develop 
y ‘significant vocational interests; for different persons, the 
_ age differs.” (2, p. 187.) 
_ To further clarify the implications of the basic as- 
| sumption, two corollaries are required: 
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1. The degree of clarity of an interest type will vary! est 







positively with the degree of acceptance of the occupa) eit 
tional stereotype as self-descriptive. f to 
2. The degree of clarity of an interest type will vary” : 

the 


positively with the degree of knowledge of the true occu.) 
pational stereotype. i 
There are two hidden assumptions in the second corol-| 
lary, namely, that the occupational stereotypes implicit), P¢! 
in the Strong Blank are true stereotypes of the occupa-) SP¢ 
tions involved and that all of the occupations can truly) 18 ‘ 





be stereotyped. Both of these assumptions certainly! Th 
should and actually are being made the subject of con-| stu 
tinued research. » vid 

The basic assumption and the two corollaries form), Ble 
the foundation of the view of vocational interests taken) Pat 


in this paper. If under personality we include the specific” alit 
long- and short-term goal-directed strivings of the indi-” 
vidual, then this view of interest patterns may be 
described as considering these patterns as by- products” 

of the individual’s personality. We must recognize that] pos 
these strivings are in a state of flux, changing to meet the mes 
fluctuations in the situation. Where the concept of the” 
self becomes incompatible with the present goal, a stat 
of disequilibrium is created which can only be resolve 
by some reconciliation between these two factors. 








Deductions ~ peo 

Having stated our hypothesis, we turn to the con 1: 

sideration of its power to encompass the known dat 
about the Vocational Interest test and to predict news 

facts. We shall divide our deductions into those leading” por 

to results already observed and those leading to hypothe 

ses requiring experimental verification. 





Observed ~ stuc 


1. It has been observed that there is a significant — 
relationship between father’s occupation and son’s inter) exper 


54. ; 





A THEORY OF VOCATIONAL INTERESTS 


est type (1, 7, 8). This is a result which can be fitted into 
either a static or dynamic theory. Our theory would lead 
to this deduction on the basis that a student’s concept of 
himself is likely to be affected by an identification with 
the father. A static theory is likely to predict the same 
phenomenon on some genetic basis. 

2. A number of studies have revealed that various 
| personality characteristics can be shown to differentiate 
» specific interest types from all others (4, 5, 6,10). This 
_ is a finding which is easily encompassed by our theory. 
The very nature of the personality tests used in these 
studies assures such results. These tests require the indi- 
vidual to give his picture of himself, much as the Strong 
Blank does. Therefore, where the stereotype of an occu- 
pation involves a personality trait covered by a person- 
ality test, it is logical to assume that there will be a rela- 
tionship between the individual’s response in the two 
testing situations. 

3. Several studies have demonstrated that there is a 
positive relationship between the student’s claimed and 
measured interest (2, pp. 21-25, 3). Not only does our 
theory encompass this phenomenon, but as will be indi- 
cated under the discussion of deductive hypotheses, it per- 
mits the stipulations of the limiting factors within which 
this relationship may be expected to vary. Only one 
assumption need be considered at this point, namely, that 
people are capable of manipulating the Strong Blank : 
in such a manner as to present any desired picture of 
themselves. 

One study of a restricted nature has already been re- 
ported to demonstrate that freshmen and sophomore stu- 
_ dents in a junior college were able to manipulate the 
teacher-administrator interest pattern at will (2). In 
order to test this question further, a group of graduate 
students,* virtually all of whom had taken the Strong 


*Five staff members of the University Testing Bureau also took part in the 
experiment. 
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Educational Psychology who were attending a class in) 
the clinical practice of counseling. As might be expected, 4 
most of these students had exhibited “welfare” patterns) 
on previous testing. 4 

In all, twenty-five subjects took part. Five were asked | 
to simulate a medical pattern for group I, six to simulate” 
an engineering pattern for group II, five to simulate an? 
accounting pattern for group XIII, four to simulate a7 
salesman’s pattern for group IX, and five to simulate a) 
lawyer’s pattern for group X. Since these subjects were! 
sophisticated with regard to the test, it was also possible) 
to talk about group names in addition to giving them af 
pivotal occupation as a frame of reference. It may legiti- 7 
mately be asked whether the sophistication of the sub-| 
jects invalidates any results that may be obtained. To! 
arrive at this conclusion is to make the apparently un-) 
tenable assumption that sophistication with regard to the 
purposes and interpretations of the test gives one knowl-) 
edge of the specific weights attached to any response,” 
Even if it were probable that these subjects could and 
would memorize the complex weighting system which 
this test has, this asumption fell down completely when) 
questioning ‘revealed that virtually none of the subjects” 2 
had ever more than glanced at the weighting system and 
none had ever scored a test by hand. 

Table i summarizes the findings by presenting thee i 
number of each level of letter grades for each of the” 
occupations in each of the interest type groupings which 
could be observed for each of the five experimental) 
groups. The five experimental groups are defined by the! 
occupational set which was suggested to them. To illus-! 
trate, the table indicates that the five subjects who we 
given the biological scientific interest set answered the/ 
Blank in such a manner as to score 14 A, 8 B+ to B 
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test previously, were asked to fill out the blank. For the j 
most part, these were students in either Psychology or! 
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TABLE 1 


SIMULATION OF FIVE VOCATIONAL INTEREST TYPES BY 25 SUBJECTS 
BY MEANS OF THE STRONG BLANK 








D STRONG 
OOPEREST TYPE IN EXPERIMENTAL INTEREST SET 


TERMS OF LETTER GroupI Group II Group XIII GroupIX Group X 
GRADES N 5 N 6 N 5 N 4 N 5 
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Group I A 
Biological Bt toB— 
Scientific C+ toC 


Group II A 
Physical B+ toB— 
Scientific C+ toC 


Group V A 
Welfare B+ toB— 
C+ toC 


Group VIII A 
Business B+ toB— 
Detail C+ toC 


Group IX A 
Business B+ toB— 
Contact cr rtc— 


Group X A 
Verbal B+ toB— 
Cre c— 
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and 3 C+ or C grades on the occupation keys included 
in this interest group. 

: By noting the extreme preponderance of A grades 
_ for the occupations included in the interest type defined 
by the particular experimental set, we see that without 
_ exception the subjects were successful in simulating the 
~ interest type required. In questioning the subjects as to 
" the method used in the simulation, the invariable re- 
_ sponse was that they had answered in terms of their 
' impressions of what the typical salesman, doctor, etc., 
would say. In other words they were expressing their 
stereotype of a salesman, doctor, etc. Further inspection 
- of Table 1 reveals that the stereotypes of a doctor and 
_ engineer are quite interrelated, that the stereotype of a 
business detail worker seems to be the most independent 
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of other interest types, that the stereotype of a verbal i 
interest type occupation is almost identical with the | 




















































stereotype of a business contact type, although the re- Fp 
verse is not true. E te 
This evidence is clearly consistent with our original) R 
theory and provides a basis for deducing a relationship | in 
between claimed and measured interests. Although we) % 
must reject the objection that a sophisticated group | th 
would be able to simulate interest patterns because they) 
knew the weighting system, we would have to accept the | a 
statement that this group was atypical in that it was/ ye 
more likely than an ordinary student group to be ac- |) ‘ 
quainted with the true occupational stereotypes. How. | he 
ever, this acceptance does not preclude the possibility) ;, 
that ordinary persons would also know the true occupa- 4; 
tional stereotypes. In the writer’s clinical experience one | pe 
case stands out quite clearly. This student was taking pre-/ gp, 
medical work and had filled out a Vocational Interest | re 
Blank which showed a “‘welfare” pattern and very little” 
resemblance to men in scientific occupations. In talking | 
with this student, the writer asked him to describe his) |, 
idea of a doctor. The student prefaced his description by Ss . 
stating that what followed was his ideal of a doctor and | ol 
proceeded to describe a “welfare” type. When asked tof) ,, 
describe what he thought doctors are really like, he then) 4¢ 
described the scientific type of person. He was then asked” 4, 
to fill out the blank in conformity with his conception of o, 
what doctors were really like. The scoring of this test) 4;, 
revealed a typical scientific pattern and an almost com-| po 
plete elimination of the “welfare” resemblance. Many! op) 
similar clinical experiences where students had filled out! tin 
the blank with a new set have convinced the writer that) po: 
the completion of projected studies of interest pattern” tyr 
simulation by undergraduate students will reveal the’ jfe 
same results, though in lesser degree, as were reported) aby 


here with regard to graduate students. 
58 
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1 = 4. One of the major facts which Strong has estab- 
>| lished concerning his blank is the continuity of interest 

patterns (13). In general he has found that these pat- 

» terns become more stable as the group studied is older. 
|| Reading in between the lines of most discussions of the 
,| interest test phenomena, this fact is taken to mean that 
.|- Strong interest patterns are fixed, once developed, and 
_ therefore any actual changes are due to unreliability or 
- other types of error. But our theory can encompass the 
_ same phenomena without recourse to the catch-all concept 
| of error. First of all, we assume that it would be acknowl- 
_ edged as a social-psychological and sociological fact that 
"the older the individual is, the more likely it is that he will 
| have established himself occupationally and the less likely 
‘| it is that conditions will require a change in this occupa- 
-F tion. This would be particularly true for the college 
' populations which have formed the major source of 
' study. Where individuals do show changes, we can cor- 
relate these with changes in his situation and goals rather 
than ascribe them to error. 


5. A final known fact about the Strong Interest test 
' phenomena is that small positive relationships may be 
' found between interest scores and performance on 
' achievement tests or grades in courses (11). Some, no- 
' tably Fryer, have contended that the study of the amount 
_ of information that an individual has in each field would 
' be the best avenue for the estimation of his interests. 
Our theory would suggest that an individual’s informa- 
» tion and achievements would represent only one of many 
| potential factors in his interests and therefore could have 
- only a limited contribution to the understanding or es- 
_ timation of vocational interests. However, we should 
_ point our that our second corollary suggests that another 
_ type of information plays an important role in the man- 
| ifestation of an interest type, namely, the information 
_ about occupational stereotypes. 

Thus we see that accounting for these basic known 
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facts about Strong Vocational Interest phenomena places | 
no undue strain upon our theory. No claim is here mad B th 
that we have systematically surveyed every study which! b. 
has been performed on this instrument, but we have in-| « 
cluded what seem to be five basic and well established! h: 
facts. a 
Predicted m 


iw 
We come to the severest test of a theory, its ability | : ” 


to open up new directions of research and to predict out- 7 . 
comes. All of the hypotheses which will be presented i 
this section will represent feasible studies, some of whic 
are already in progress as part of the program of research) P* 
in the clinical applications of the Strong Blank which is) 
being conducted in the University Testing Bureau, Uni-/ di 
versity of Minnesota. It is hoped that other interested sch 
psychologists will attempt to check the adequacy of thes 
hypotheses. sti 
The basic assumption and its two corollaries which” w 
have been stated above form the origin of the set of te 
hypotheses which follow: gu 


1. Hypotheses with regard to relationships between” ,,, 
father’s occupation and son’s measured interest: Ww 


The more social status attached to father’s occupation, si: 
the greater the relationship. ce 


The closer the emotional bond between father an 
son, the greater the relationship. 


The longer the occupation has been in the family, the! de 
greater the relationship. “tic 


What amounts to an over-all hypothesis would b 
stated as, the greater the identification with the father, tw 
the greater the relationship will be. 


Where the son feels inferior to the father, there is hY 
likely to be a discrepancy between father’s occupation) th 
and measured interest. © 
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¢/ It can be seen that the basic variable underlying 
le) these hypotheses would be the degree of identification 
hl between father and son. In this set of hypotheses, the 
n-| corollary with regard to knowledge of the stereotype 
d) has been neglected to the extent that knowledge is as- 
7 > sumed to be at a maximum. This avoids introducing too 
' much complexity in our hypothesis. However, any study 
B would need to consider both corollaries, meaning that 
' several hypotheses must be considered at once. This will 
. ~ become clearer as the predictions are developed further. 
7 ' 2. Hypotheses with regard to relationships between 
h ' personality and interest type: 
; | Those occupational stereotypes which involve some 
_ differentiating personality characteristic will reflect that 
A ' characteristic on tests of the trait. 


se’ — It is felt that the relationships between the relatively 
i static personality traits and interest types has been fairly 
ch ‘ _well explored. Deeper insights into the dynamics of in- 
of | _ terest types should come from the leveling of our research , 
" guns at the question of the development of the individ- 
~ ual’s concept of himself as reflected in his goal-directed 
'strivings and the effects of the barriers he encounters. 
4 While we cannot state it clearly as a deductive hypothe- 
_ sis, there seems to be the possibility that some self con- 
"cepts are more easily discarded than others. Strong’s, 
a hwting (13) that correlations of tests taken in the senior 


en 


ie i cational scale from .50 to .80 may be interpreted as evi- 
dence supporting the possibility of variability in the elas- 
_ ticity of self concepts. 

_ 3. Hypotheses with regard to the relationship be- 
~ tween claimed and measured interest: 





A restatement of the corollary gives us our basic 

is hypothesis, namely, that the greater the knowledge of 

_ the occupational stereotype, the greater the relationship 
between claimed and measured interests. 
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The more specific the individual’s knowledge of and) 
experience with a particular occupational stereotype | 
the more specific will be his interest type. ; 





This hypothesis requires further explanation. By 
specificity of interest type, we refer to the phenomenon’ 
of individuals who show a very close resemblance to one 
occupation within the interest type and virtually no rey ' 
semblance to the other occupations in the interest type E t 





There will be a greater incidence of specific interes” 
types among older subjects. 


This hypothesis and the one that precedes it shoulé| 
be tested together since they are clearly interdependent : 





Those occupations in which the workers are mor! 
stereotyped will exhibit a greater relationship betwee 
claimed and measured interest. | 


Those occupations in which the workers are mor 
stereotyped will show a greater test-retest correlation 4 


4. Hypotheses with regard to the continuity of in h 
terest type: , Yl 

If we divide a college population, all of whom hav © 
been tested and retested on the Strong Blank, with a °% 
appreciable interval intervening, into the followin © 
groups: f 

a. those who were following curricular plans conse 
nant with their interest type at the first test and continue ¢! 
with these plans in the intervening period, E 

b. those who were following curricular plans con 
sonant with their interest type at the first test and changet 
to a curricular plan not consonant with the first test dur 
ing the intervening period, 

c. those who were following curricular plans not con ~ 
sonant with their interest type at the first test and change te 







Sata 






to a curricular plan which was consonant with their fir T¢ 
test in the intervening period, of 
sh 


d. those who were following curricular plans n0 
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consonant with their interest type at the first test and 
continued with these curricular plans during the inter- 
vening period, 
e. those who were following curricular plans not 
- consonant with their interest type at the first test and 
ne. changed to some other curricular plan still not consonant 
e| with their first test in the intervening period, 
De p the following hypotheses are deduced: 
Group a will show the greatest test-retest correlation. 
Group c will show almost as high or even just as high 
a test-retest correlation as group a. 
nth Groups 6 and e will show the lowest test-retest corre- 
£ lations. 
: 



































Group a’s test-retest correlation will probably vary 
within the limits set by group a and group 3b. 
These deductions involve the idea that a change in ,.— 
mt curriculum and consequently a change in goals will prob- 
MM) ably involve an adjustment of the individual’s picture of 
. himself. Where the change involves a turning toward a * 
well established picture, then no change in the interest 
ye type would be expected. The more drastic the change in 
ar occupational orientation, the less relationship would be 
nm expected between test and retest. 
: The experiment which embodies the test of the above 
; set of hypotheses seems to be one which is crucial to the 
ei choice between the static and dynamic types of theories. 
Exponents of the static view must necessarily assume 
that curricular experience, particularly at the college 
level, should have little or no effect upon the stability 
of the interest pattern. If it can be shown that the above 
set of hypotheses, representing a systematic account of 
_ changes in relation to curricular experiences, are at all 
_ tenable, then the dynamic theory would be well on the 
: road to establishment as the most acceptable explanation 
_ of vocational interest phenomena. If these hypotheses 
should fail to be substantiated, it still would not represent 
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a permanent setback to the dynamic theory, providing! 
the majority of the other hypotheses presented in this) 
paper are proved tenable. In being capable of providing} ; 
a logical basis for the deduction of the large number of} 
new experiments embodied in our hypotheses, this theo.) 
retical approach has already established its contribution.) 


Significance for Counseling | 
Some psychologists who have leaned heavily upon the) 
Strong Vocational Interest Blank in their clinical work! 
may feel that if the dynamic theory is substantiated the! 
Blank will lose its value. This view is likely to result! 
from a consideration of vocational interests as contribut-) 
ing a rather fixed characteristic of the individual in the” 
same manner as aptitude tests. The usual frame of refer. 
ence is that the clinician’s major purpose is to arrive at) 
a prediction of the individual’s vocational success or satis- F 
faction. However, few of these workers would disagree 
that the knowledge of the goals which motivate their, 
clients is of prime importance for clinical work. That 
these goals cannot be accepted as fixed characteris) 
if evidence indicates that such be the case, is a necessary ° 
assumption if the clinician is to avoid bad errors in his) 
predictions of vocational satisfaction, or even worse) 
avoid the error of having operated persuasively on a 
fallacious assumption. 
In the writer’s opinion any loss to this instrument in 
terms of long-term prediction will be more than com- 
pensated by the clinical insights which may be gained 
from a consideration of the phenomena hypothecated) 
This opinion is based on the assumption that one of the 
prime functions of the clinical psychologist is to aid the 
client to develop greater insight into his feelings an 
motivations as well as his abilities and aptitudes. Thes 
insights should then lead to an increase in the client 
ability to formulate goals which will lead to maximu 
satisfaction. In this frame of reference, the Strong Vo 
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cational Interest Blank is an excellent instrument for the 

is! collection of information about and the development of 

: insight into one of the important sources of human 

' motivation. 
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NOTE ON THE RELIABILITY OF 
RATIO SCORES 


LEE J. CRONBACH 
State College of Washington 


N A PREVIOUS ARTICLE,’ problems involved in 

studying the reliability of ratio scores were discussed, 

B and methods of computing the reliability presented. The 

" present note describes two procedures of some theoretical 
> interest, but little practical importance. 

_ Constant denominator method. The formula pre- 


" sented previously is not valid for ratios Z 4 unless the varia- 


' tion of the group in b is small compared to 3 itself. For 
"values of 6 which do not satisfy this condition, an ap- 

p proximate approach known as the “constant denomina- 

tor” method may be used. Except for groups where every 

* student has the same denominator score as a result of 
e testing conditions, this method gives only a rough esti- 
f mate of the reliability. It was indicated in the earlier 
article that the reliability of the ratio will vary with dif- 
_ ferent values of 6. Within any large group, it should be 
_ possible to obtain estimates of the values of the reliability 
: corresponding to different b-scores represented in the 
_tange. This is accomplished by dividing the total group 
“into sub-groups, each of which contains students whose 
_b-scores range over only two or three points. In each sub- 
4 group, except where b is exceedingly small, the standard 
deviation will be small compared to the mean of b. For- 













1Lee J. Cronbach. “The Reliability of Ratio Scores,” Educational and 
ie »P. sychological Measurement, I (1941), 269-278. 
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mula (4) or (7) from the previous article can be applie!_ 
to each sub-group in turn, yielding an estimate of th! 
standard error of measurement of the ratio correspondin 
to the mean value of b in the sub-group. If one can assum) 
that for the test studied r,, is independent of a andr 
is independent of 5 (this is the common interpretation) ; 
of reliability), values of these statistics computed for th} 
total group may be used for the sub-groups after applyin)_ 










W 
Kelley’s correction for the changed variability of th) jg 
group. Only the means, standard deviations, and r,, nee c 
be computed for each group. If a large number of casl 





is available, it may be possible to select sub-groups each! 
containing only students whose b-scores are equal. In thi) 
case, 0,=0 and formula (4) becomes 


Too = Tass (8) 
oo 













r,, can be computed for each sub-group, or obtained fro 
the value based on the total group. i 

If estimates of the reliability are obtained for sizeabl 
sub-groups scattered over the entire range of scores, it i) 
possible to plot the standard error of measurement of th 
ratio against 5 and fit the points so obtained with 
smooth curve. It is desirable to plot the standard error o 
measurement rather than the reliability, against b, as th 
reliability varies with changes in the spread of th 4 
group.” | 

It will be noticed that the procedure outlined het 4 
tacitly assumes that the reliability of the ratio depend) , 
only upon errors in the numerator, i.e., that the unrelia) t 
bility of the denominator does not effect the reliability aff 
the ratio. This is only true where the denominator is nat 
a variable. Probably no serious error is introduced wher t 
the denominator score, while a variable, is highly relin i 


















*This plotting procedure, in which different standard errors of measur) 
ment are — for different positions in the range, resembles a metho 
described by J. C. Flanagan for use with scores of the usual type, where ratis 
are not involved. See J. C. Flanagan, Scaled Scores. (New York: Cooperatin 
Test Service, 1939), pp. 15-16, 30. 
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liei ple. In this case, one would expect that error in the ratio 
tht would arise largely from errors in the numerator. This is 
inf jllustrated by such a denominator score as C. A., which 
im! can usually be determined without error. As the reliabil- 
ri) ity of the denominator decreases, the constant denom- 
laf inator method becomes increasingly inaccurate. If errors 
th’ in the numerator are likely to be correlated positively 
in} with errors in the denominator, the reliability reported 
th! is probably too low. If errors in the numerator have a 
cei! Jow or negative correlation with errors in the denomina- 
St tor, the obtained estimate of reliability will be too high. 
cl 7 Integration method. It has been pointed out that one 
hi cannot speak of “the reliability of a score” as a value 

_ which applies equally well to any ratio within the popu- 

| lation. How great the error of measurement of any score 

' is likely to be varies with the score itself. A fairly pre- 
mm cise but laborious procedure which acknowledges this 
_ fact is the integration method which may be used where 
a+c=4b. This case is frequently encountered in per cent 
accuracy scores, where b is number attempted, a number 
right, and c number wrong. It is necessary to assume that 
errors of measurement in a and c are normally distrib- 
uted ; this condition is probably not satisfied when the dis- 
tribution of b is skewed, as when most students attempt 
all items. 


Required are omy » Ones, and r,,. One assumes that 


all values of a;, c; obtained by repeated measurement of 
any individual will be distributed normally about the ob- 
tained scores aj, cj, and that Tae, = Tag One may assume 













, unless there is reason 


meas c 


that al ee and that 0, = 9, 





to believe that the reliability of a or c varies with the size 

of aorc. In that case, values for o, and o, must be ob- 
2 d J, 

tained directly from a group of cases having scores at 






or near a; or c;. One may conceive all possible values of 
4;, ¢; such as would be obtained by repeated measure- 
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ments as plotted in a frequency surface with axes a and, 


To determine the probability that ; =i 4 __ exceeds 4 
| a 


] 
b; ase; 
any given value 7;+¢, one needs but to integrate the nor. 
mal two-variable probability function as follows: 


1 i 

oo > = j! jv 7 ef ’ 

ie { (7 te, {- 27049. Vv =, da, dc, dz (\E 
O F 


—0 





—c 


where ¢ is 


_=1_ (8, G-O*_ Yala) G-6) 
2(1—7?,.) Ta, “ Ta; %e; 





Ts. 
°j 


—Ss ores - a 


Since a separate evaluation of the integral, which is) 
mathematically laborious, for each set of scores a’, ¢’,? q 
andé¢ is required, the method is not likely to be practical | i 
for most purposes. a 

Both of the methods presented here serve to empha) : 
size the fact that the reliability of any ratio score isa) 
function of the size of the denominator. From this, it be-F 
comes clear that one cannot obtain a reliability coefficient” 
for a ratio score and expect that coefficient to be equally) 
applicable to all scores in a sample. Under certain condi- 
tions, as set forth in this and the preceding paper, such a) 
reliability coefficient may be meaningful, but in general| 
it must be recognized that determining the reliability of) 
a ratio score is a problem requiring careful analysis an 
interpretation of results. 


Ss =e = FS 


o0 kt’ o Oo” ome oOo eS 





WARTIME ACTIVITIES OF PERSONNEL 
WORKERS IN THE AUTUMN OF 1942? 


N SEPTEMBER 25, 1942 the following request 
was sent to all members of the American College 
' Personnel Association: “Describe in brief terms your 
| present responsibilities in the war effort. Please tell 
' briefly what you as a personnel officer are doing, whether 
. | you be in the armed forces or whether you be participat- 
yf ing as a civilian. Do not hesitate to list some of your 
_ normal functions which are directly connected with the 
’ war. For example, many of you may be continuing your 
' responsibility for counseling students by giving in this 


‘| responsibility special emphasis to orienting students in 
> the role they should play in the war. This is war effort. 

‘) Please list all of your responsibilities which are in any 
» way connected with the war.” 

:| Replies were received from 115 persons. An attempt 
has been made to organize the activities mentioned in 
' such a way that the outlines may serve as job analyses of 


*Prepared by Grace E. Manson, American College Personnel Association Editor, 


- anannouncement from whom follows. 


Be The American College Personnel Association has at long last reached one of 
> its goals. It has an official organ. Through the wisdom and initiative of Dr. Wil- 
~ liamson, Dr. Feder, and the Executive Council, and with your hearty approval 
' (99 per cent in favor), an arrangement has been made with Educational and 
| Psychological Measurement whereby a certain amount of space in each issue will 
be allotted to the Association. Articles are solicited which will make a contribution 
to the attainment of the purposes of personnel work as defined in the charter of 


| the ACPA. 


4 During these strenuous times when an increasing number of our members will 
be away from their usual positions and when meetings of the Association may be 


- cancelled, it is important that we hold together our interest in personnel work and 


in one another. It is to be hoped that articles in the Journal will aid in accomplish- 
ing the first objective and that a section devoted to news notes will aid the second 
objective. You are therefore urged to send both articles and news notes to your 


"editor, Grace E. Manson, Northwestern University, Evanston, Illinois. 
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personnel work done in contributing to the war effort inf 
the fall of 1942. Since the majority of workers were still 
at work in the colleges, the analysis of work done in the) 
educational areas is the most reliable one. During the fall | 
of 1942 enrollment in most colleges had not dropped | 
sharply but the male students, though still on campus) 
were entering the reserves. Rumors were afloat that) 
women would be registered for war work, but no govern. | 
mental action had as yet been taken. A similar survey) 
made in the fall of 1943 may show interesting change! 
in how college personnel workers distribute their time) 
and effort. 3 
The informal nature of the inquiry yielded data 
which did not lend themselves to refined statistical analy. | 
sis. There seemed to be considerable variation in what 
individuals considered important enough to mention/ 
The variety and form of expression, often in terms of the : 
local situation, made it difficult to be sure of the inter-” 
preted meaning. However, the results indicate definite! 
trends. 
The outlines have been built up empirically. They are) 
on a functional! basis and a count has been made of the! 
number of times a duty was mentioned or implied. The! 
subjective interpretation of the classifier undoubtedly) 
brings in a considerable margin of error. The job analysis! 
outlines will be given in the following order: 

















io ake atl 





(1) Activities of personnel workers in the armed | 
services. E 


(2) Activities of personnel workers in the govern-| 
ment. 


(3) Activities of personnel workers in industry. 


(4) Activities of personnel workers in private non- 
profit personnel organizations. ' 





(5) Activities of personnel workers in educational — 
institutions. ae 
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rt in 1 Activities in the Armed Services 
stil/ | Eleven members of the A.C.P.A. who had entered the 
the) armed services replied. 


fall 3 were in the Army 
yped | 7 were in the Navy 
pus, | 1 was in the Marines 
that j 


Regulations permitted descriptions of duties only in 
er general terms. In summary form, the functions with the 
'veyF times mentioned were: 








igs Recruiting (1) 

ime ® Selection and Placement (10) 
q Training (4) 

data) Neuro-psychiatric services (5) 

aly: | Research (3) 

se ' Table 1 gives the detailed analysis. 

the 7 TABLE 1 

ter: ACTIVITIES OF PERSONNEL WORKERS 

nitel IN THE ARMED SERVICES 
: Number Times Mentioned 
ESTE ROE OE I Ee PTO 1 

are’ B. Selection and placement................ I 

the | ee rere eee ee 3 

Phe ’ i, IIE nc ce sve wecaeeves 2 

dy | er eee 2 

ysis | 4. Occupational classifications ......... 2 
_ C. Training 

wal ee ae ] 
I ib ays Gobind ae dike @8 1 
> Bewcationsl guidance .............. l 

orn | 4. Counseling on personnel problems.... 1 
_ D. Neuro-psychiatric services 

, | i ha oso 5 comm wo a 2 
e Eee eT Teer eee l 

100: | ID. cs ov penser ce seya cane 2 
_ E. Research 

nalé ee er | 


2. Analysis of failures ................ 2 
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Activities in the Government 

Two members of the A.C.P.A. reported that they 

were doing government work. One was with the USF 

Employment Service, the other with the War Manpowerl 
Commission. Their duties are given in Table 2. id 


TABLE 2 
ACTIVITIES OF PERSONNEL WORKERS IN GOVERNMENT 





Number Times 
Mentioned 


A. Job analysis and classification 


B. Training 
1. Setting up of service training programs 1 





Activities of Personnel Workers in Industry 


Three members who were doing personnel work in) 
industry reported on their activities, which are listed in) 


Table 3. 


TABLE 3 a 
ACTIVITIES OF PERSONNEL WORKERS IN INDUSTRY 4 C 





Number Times 

Administration Mentioned 
1. Problems due to change to production 

of war goods 
2. Problems due to loss of technically 

trained staff officers to armed services 

and government work 
Hiring 
1. Recruiting in a scarce market 
2. Selection 

a. Replacements 

b. Employees for new jobs 
Training Ww 
1. Supervisors me se 
2. Women for men’s jobs Ep 
Orienting 6 
1. Keeping up morale > ir 


1s eres 
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Activities of Personnel Workers in Private Non-Profit 
hey | 
igh Personnel Work 


we! Five replies were received from members who were 
' doing work with service organizations or on a private 
_ basis. Their activities are given in Table 4. 


— FF TABLE 4 


ACTIVITIES OF PERSONNEL WORKERS IN PRIVATE 
NON-PROFIT PERSONNEL WORK 





Number Times 


d Mentioned 

_f} A. Setting up service programs............ 1 
ee | ae ree 1 

7 ‘ B. Giving occupational information 

ine A aa ied aia Wil ew dea ae Kee 2 
4 PO aint aude sdeaseawteuawes 2 
Oe, NE i PEAY Saeko ke ae enenes 1 
' C. Educational guidance 

Ee en ee ne 1 

i ak hee bee Maeno eS 1 
q Pe VOCRTIONRl BUIGORCE «. 2. oc ccc ces cence 2 
_ E. Training for personnel work............ 1 


. SEER a POET TEE 1 





Wartime Activities of Personnel Workers in 
Educational Institutions 


_ By and large the greatest number of members were 
| working in educational institutions. Ninety-four of these 
» sent information about their wartime activities. These re- 
' plies have been analyzed and classified in Table 5. Table 
- 6isa summary of Table 5 showing the order of emphasis 
_) in terms of the number of times the activity was men- 
tioned and its percentage of the total activities mentioned. 
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TABLE 5 
WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 













Number Times 






| 




















Mentioned 
oe a si ein wie act l 
Te 9 
2. Additional duties arising out of ‘ 
a. Loss of trained staff members...... 5 : 
>. New emiguments ............... 7 : 
B. Liaison work with 
ee 26 
ne 3 
hifi ue tl asta Sb at ¥ stn OC | 
4. U.S. Office of Education............ 4+ 
eR a drt 2 ik Ni a ak baie 5 
C. Campus Committee work 
1. Faculty-Student personnel committees 1! 
\ eee Terre 5 
Be. ID ins iver eegeice cvneeswes 5 
i iets a pee i ahah bel-owke: oe ; 
ee 1 
b. Setting up new professional courses 2 
c. Non-credit courses .............. 2 





5. Student committees 
a. Working with students in arranging 






(1) Assembly programs ......... 2 E 
(2) War activities projects....... 2 
(3) Occupational information con- E 
RE th wwe e hii Baten nein» 4 
(4) Orientation programs ....... 4 : 
D. Counseling and guidance services....... 5 : 
l. Undergraduate men ..........05.55: 7 : 
a. Obtaining and dispensing informa- 3 
tion about 





(1) Requirements of the various 
branches of the armed services 22 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 





Number Times 
Mentioned 


(2) Deferment and reserve classi- 

EE eS kcaieiackae iene 
(3) Course programs for reserves. . 
(4) Balsotments ............55. 
(5) Defense courses ............ 


b. Assisting students to make decisions 
on problems arising out of the war 
by 
OR NN ac cen ania okt a 
(2) Educational guidance ....... 
(3) Vocational guidance ........ 
(4) Remedial work ............. 
(5) Counseling on personal prob- 

lems including post war plans 


c. Orienting students to college life 
under war conditions........ 


2. Undergraduate women 


a. Obtaining and dispensing informa- 
tion about 
(1) Opportunities for women in 
war work 
fe nr eee 
CWP VORMMOIEE os ces ccce ness 
(2) Defense courses ............ 
(3) How and where to serve..... 


b. Assisting students to make decisions 
on problems arising out of the war 
through 
ee 
(2) Educational guidance ....... 
(3) Vocational guidance ........ 


c. Counseling on personal problems 


related to men and marriage...... 
77 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 





Number Times 
Mentioned 


d. Orienting to college life under war 
conditions 7 

Graduate students 

Aljumni 

Parents 

Faculty members 

High school administrators and coun- 

selors 


8. High school students 


E. Extra-curricular activities 


1. Arranging social programs for students 
and men in the military services 


2. Maintaining programs in sports and 


recreational activities 


3. Supervising war-time service projects 
as part of the extra-curricular program 


F. Housing 

1. Providing living quarters for military 
units assigned to the campus 

2. Providing food services for military 
units and regular students with food 
rationing, scarcities, high costs, labor 
problems 
Making adjustments due to scarcity of 
residence facilities 


G. Placement 
1. Endeavoring to secure applicants for 
employers’ numerous calls for full- and 
part-time workers 


Keeping students and alumni informed 
of 
a. Job trends 


































WARTIME ACTIVITIES OF PERSONNEL WORKERS 


WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 





Number Times 


Mentioned 
b. Job requirements ............... 5 
c. Job opportunities in public and 
private organizations ............ 
3. Administering N.Y.A. aid .......... 3 
4. Making plans for “school and work” 
I iu baie ben cnahee ner eneene 3 
5. Providing employers information about 
qualifications of applicants.......... 4 


. Editorial work 
1. Preparing pamhplets on: 

Requirements for military services. 
Course requirements for reserves. . 
Preparation for non-military service 
EPEDOMME COUNORE 2... «0. nce ccccccs 
Opportunities for women......... 
CAVING GOBONOE 25... cee cescsscss 
Job trends and requirements...... 


wre op 
ee eet et et et 


Supervision and Instruction 
1. Regular courses related to war work.. 10 
2. Specialists courses for the armed 





I ie ii Gia dp week CS AS 6 
3; TPORUMOG COUN 2... 6c eee ees 7 
4. Training courses for child care...... 4 
5. Physical education and health programs 1 
Re Rene CIEE: 5 nc ince eb eccewsees Z 
7. Defense nursery schools............. 1 


J. Admissions 


er eer rer er are 4 
2. Giving information about 
i IID: bing none ve cece cncees 3 
mp. Courses for reserves............. 2 


K. Registrations and records 
ee 2 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 





Number Times 
Mentioned 
2. Problems arising out of new credit and 
non-credit courses 


L. Research 


Personnel techniques 

Surveys 

Selection for short courses 

Effect of war on maladjusted student. . 





M. Part-time consulting work, special projects 
1. Consulting work with 
a. Armed services 
(1) Advisory to military officers. . 
(2) Selection of personnel 
(3) Training courses 
(4) Recreational programs 
b. Defense industries 
(1) Selection of personnel 
c. Government agencies 
(1) Testing 
(2) Training 
d. Individuals 
e. Professional groups 
2. Special projects 
a. Administrative work 
b. Testing 
c. Training 


N. Off-Campus Committee Work 


1. Service on national, state, or local com- 
mittees and boards 
American Council on Education. . 
National Research Council 
State and local councils 
Manpower commission 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 


















es Number Times 
Mentioned 
c. GOW committees .. «5.6.0 cee. 4 
f. Professional groups ............. 4 
ge. Child-care agencies ............. 1 
h. Civil service commissions......... 1 
rrr 2 
0. Participation in activities as member of the 
_ Community 
ee ee eer er ore eee 4 
ee 6 gat ca i se a Whe Ral 2 
ON SE ee 2 
S @ Gommemiiey fands............5.455 1 
5. Other service organizations.......... 5 
TABLE 6 
SUMMARY OF WAR-TIME ACTIVITIES OF PERSONNEL 
WORKERS IN EDUCATIONAL INSTITUTIONS 
Number Times Per Cent of 
Mentioned Total 
Counseling and Guidances 
REE ee eee 223 45.93 
re 39 8.02 
re 37 7.61 
_ Campus committees .......... 32 6.58 
' Supervision and instruction.... 29 5.96 
_ Part-time consulting work..... 29 5.95 
Off-campus committees ....... 23 4.74 
S Administration .............. 22 4.53 
' Participation as a civilian 
community member ....... 14 2.87 
= Editorial work .............. 11 2.27 
I i sick baie arn 9 1.84 
Extra-curricular supervision... 9 1.84 
EEE ere 6 1.24 
Registration and records...... 3 62 
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Although the selective factor of the positions heli) 
by the individual replying determines the activities men) 
tioned, there seems little doubt that counseling of studen) 
is an important and frequently occurring function of 
college personnel workers in wartime. Placement wor) 
also ranks high on the list. q 

One needs to keep in mind the fact that these record} 
were obtained during the first stage of the transition of 
campuses to a wartime basis and during the period wha} 
the male students were in the process of joining the rep 
serves. The draft age had not yet been lowered to eighteen) 





EXECUTIVE MEETING OF THE COUNCIL 
OF GUIDANCE AND PERSONNEL 
ASSOCIATIONS: A REPORT? 


' The officers, members of the executive councils or 
' trustees, and committee chairmen of the various organi- 
» zations which comprise the Council of Guidance and 
' Personnel Associations met during the week end of Janu- 
© ary 15-18, 1943, at the Hotel Biltmore in New York. 
' Inasmuch as the various associations had found it neces- 
' sary to cancel the usual February convention because of 
© travel difficulties, this meeting was planned as a wartime 


- substitute. There was opportunity for the official staffs 
' to meet separately to transact necessary business and to 
' take appropriate action initiated at the general meetings. 
' Dr. Layton, President of the Board of Representa- 
' tives, defined the task of the group in his invitation to 
' the conference as follows: 


' 1. To consider war needs in government, business, 

' industry, and education which may be met by profes- 

_ sional personnel services; 
These needs are for adequate counseling for youth to the end 
that they understand their capacities, interests, and aptitudes and 
are aided by wise guidance to find their place in the national 
service, whether in the armed forces or in school or on a job in 
business or industry. This applies to all high school, college, and 
out-of-school youth and to such adults as may be reached by 
guidance and personnel services. 

2. To make a statement of resources available 

' through the Council which are contributing and can 

' contribute further to meeting these needs; 


—_—. 


*This report was prepared by Helen M. Voorhees. 
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There are about 4,600 professional persons who belong to the 
organizations affiliated with the Council and who are in more 
or less direct touch with several millions of Americans of school 
and college age and can serve their guidance needs in wartime, 
augmented by certain research and publication facilities which 
keep us in touch periodically with our members and with many 
other persons. 


3. To formulate specific means by which these re. 
sources can be used more widely and more effectively 
in the war effort; 


This means that those of us who are charged with the responsi- 
bilities of leadership of our professional groups must, in confer- 
ferences with each other and with invited Army, Navy, and War 
Manpower Commission representatives, consider the needs, and 
the resources for meeting them, mentioned above, and develop 
improved and possibly new services of guidance for a nation at 
war. Techniques and specific devices for practical use in coun- 
seling will be more important in this discussion than statements 
of objectives or consideration of theories. 


At the various sessions representatives of the Army 
and Navy, of government agencies directly concerned 
with welfare and educational and guidance programs, of 
the War Manpower Commission, and also of industry 
presented their needs and problems. 

The American College Personnel Association was 
represented by Dean E. G. Williamson, President; Dr. 
Daniel Feder, Secretary; Dr. James McClintock, Treas- 
urer; and Miss Helen Voorhees of the Executive Coun- 
cil. Dean Thelma Mills, of the University of Missouri, 
was a member of the Planning Committee for the meet- 
ings. Other members of the American College Personnel 
Association were also in attendance, some in wartime 
Capacities, as representatives of a branch of the military 
service or of industry. 











The subjects presented for discussion dealt with pre- 
service and in-service guidance, wartime health and wel- 
fare services, post-service guidance, post-war educational 
programs, and the techniques which are most likely to 
prove useful in solving the problems which will face all 
counselling groups in the post-war period. 
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EXECUTIVE MEETING 


It is not possible within a limited space to attempt 
any real report upon this series of important meetings. 
A committee has been appointed to edit the verbatim 
proceedings and to publish a complete report as promptly 
as circumstances will allow. It will be of interest to 
American College Personnel Association members to list 
some of the consultants from Government, industry, and 
the military forces, many of whom were in attendance 
for at least a day, frequently longer: 

Lieutenant-Colonel F. J. Agee, Personnel Research Section, War 
Department 


Major Harold C. Bingham, Classification and Enlisted Replace- 
ment Branch, War Department 


Mr. A. F. Hinrichs, Commissioner, Bureau of Labor Statistics 


Mr. Harry Jager, Chief, Occupational Information and Guid- 
ance Service 


Dr. Forrest H. Kirkpatrick, Director of Personnel Research, 
Radio Corporation of America, Camden, New Jersey 


Miss Bertha Nienburg, Assistant Director, Woman’s Bureau 
Ensign Winifred R. Quick, U.S.N.R. 
Miss Helen Ringe, War Manpower Commission 


Dr. Reinhold Schairer, United States Committee on Educa- 
tional Reconstruction 


Mr. Donald Shank, American Council on Education 
Dr. C. L. Shartle, Chief, Occupational Analysis Section, Em- 


ployment Service Division, Bureau of Employment Security 


Dr. Donald C. Tewksbury, Deputy Chief of the Pre-Induction 
Training Section, Civilian Personnel Division, War Depart- 
ment 


Dr. A. L. Threlkeld, National Director, High School Victory 
Corps 
Mrs. Marguerite Zapoleon, Bureau of Occupational Educa- 
tion, United States Office of Education 
Even this incomplete list of consultants indicates that 
busy officials thought it well worth their while to leave 
their offices in order to meet with representatives of the 
guidance organizations. Those in attendance at the meet- 
ings were keenly aware of the value to them and to the 
guidance program of this direct approach to the prob- 
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lems of those who are responsible for an important phase } 
of the conduct of the affairs of the country. 

Representatives of both the Army and Navy stressed 
the need for pre-induction guidance: for the sake of the 
draftees or enlisted personnel that they may be promptly 
classified and assigned to posts for which they are best 
fitted ; for the military forces which are in great need of 
trained men and women in various classifications. The 
group representing education and guidance is concerned, 
of course, that training programs shall not be interrupted 
unnecessarily and unwisely. That same group is anxious, 
as are we all, that post-war guidance problems may, so 
far as possible, be anticipated and adequately prepared 
for. In speaking of the reconstruction program of the last 
war, Dr. Schairer pointed out that all educational prog- 
ress has been made during the turbulent post-war periods 
of the world’s history. If history is to repeat itself, there 
will be need for greater and more inspired effort on the 
part of those who by conviction and by training are pre- 
pared to give intelligent guidance to the youth who are | 
victims of a war not of their own making. 

Throughout the group attending the meeting there | 
was a note of high courage, in the face of the frequently > 
reiterated difficulties which confront every phase of edu- [ 
cation, and a determination to make sure that those who | 
fight the country’s battles shall not return to live defeated F 
lives. q 
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MEASUREMENT ABSTRACTS* 


Arsenian, Seth. “Own Estimate and Objective Measure- 
ment.” Journal of Educational Psychology, XX XIII 
(1942), 291-302. 


The author is interested in knowing the relationship 
between the freshman’s own estimates and some corre- 
sponding objective measurements on scholastic aptitude, 
achievement, adjustment, and interests; change of rela- 
tionship, if any, between the self-estimates before and 
after the taking of the tests; and finally the characteristics 
of students who grossly over- or under-estimate them- 
selves. The results indicate a wide variation between self- 
estimates and objective measurements. However, the 
former is getting closer to the latter when the rating is 
done after taking the test. Those who over- or under- 
estimate are as a group less intelligent and less well ad- 
justed. K. S. Yum. 





in the True-false Test.” Journal of Educational Psy- 
chology, XXXIII (1942), 401-415. 


Studies of the true-false test show ‘“acquiescence”’— 


| the tendency to mark items true rather than false, when 
| guessing—influences the scores in various ways, and indi- 
| cate, particularly, that a test score may be a function of a 
) personality trait. It is suggested that more false items be 
used, since acquiescence makes them the more valid and 





*Edited by Forrest A. Kingsbury. 
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reliable, that a revised scoring formula be adopted if 
precise results are desired, and that the student be trained 
to be aware of this tendency. L. Bouthilet. 





Flanagan, John C. “The Selection and Classification Pro- 
gram for Aviation Cadets (Aircrew—Bombardiers 


Pilots, and Navigators).” Journal of Consulting Psy. 
chology, VI (1942), 229-239. 


The high proportion of military aviation candidates 
eliminated every year for “lack of aptitude” during the 
elementary training period emphasizes the urgent need 
in war time of more effective methods of selection and 
classification of aviation cadets. To this end, Psychologi- 
cal Research Units at three Army Air Corps Replace- 
ment Training Centers have been developing tests and 
procedures, which are here described. The use of the 
Aviation Cadet Qualifying Examination eliminates de: 
pendence on formal educational requirements or the 
“equivalent” academic type of educational tests. Those f 
who pass the Qualifying Examination are sent to a Clas. f 
sification Center where a further battery of aptitude and | 
physical tests is used in assigning them to bombardier, f 
pilot, or navigator training. An intensive analysis of 1000 
cases of eliminated cadet flyers provides a guide to char- | 
acteristics considered important for success, and to the} 
improvement and further development of selective and | 
classification tests. F. 4. Kingsbury. 






















Fulcher, John S. and Zubin, Joseph, “The Item Anza) 
lyzer: A Mechanical Device for Treating the Four) 
Fold Table in Large Samples.” Journal of Applied © 
Psychology, XXVI (1942), 511-522. 


The method requires no computation, hence a mini- 
mum of labor and time, giving results which approxi-| 
mate very closely the computed probability for such} 
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MEASUREMENT ABSTRACTS 


comparisons. It is based on a transformation function © 
for proportions or percentages such that © = 2 sin! V p 
in a circle, where p is the proportion or percentage under 
examination. The authors point out the applicability of 
this technique to various situations with minimum labor. 


K.S. Yum. 





Ghiselli, Edwin E. “Tests for the Selection of Inspector- 
Packers.” Journal of Applied Psychology, XXVI 
(1942) , 468-476. 


The inspector-packers in this study are girls em- 
ployed by a pharmaceutical manufacturing company for 
filling, stoppering, examining, labeling, cartoning and 
packaging. A combination of the ratings of the super- 
visor and forelady was used as the criterion of job pro- 
ficiency against the scores on the Minnesota Paper Form 
Board, Pegboard, Minnesota Rate of Manipulation— 
turning, placing—Minnesota Vocational Test for Cleri- 
cal Workers, etc. Some of the validity coefficients were 
reasonably good. A multiple coefficient of correlation is 
reported as high as .72 K. S. Yum. 





Irwin, R. Randell. “Lockheed’s Full Testing Program.” 
Personnel Journal, XXI (1942), 103-107. 


A battery of tests consisting of the Otis Self-Admin- 
istering Tests of Mental Ability, Higher Forms A, B, 
and D, Johnson O’Connor Wiggly Block, Minnesota 
Manipulative Tests, certain clerical aptitudes, and cer- 
tain trade tests, has been utilized since 1937 when Lock- 
heed Aircraft Corporation found that hardly two out 
of three new employees developed into satisfactory work- 
ers. A definite testing program is instituted for re-evalua- 
tion of active employees for promotion and guidance as 
well as for evaluation of applicants. K. S. Yum. 
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Koenig, Frank J., Major M. C. and Smith, John, Pvt 
30083518. “A Preliminary Study Using a Short Ob. 
jective Measure for Determining Mental Deficiency 


in Selective Service Registrants.” Journal of Educa. 
tional Psychology, XX XIII (1942) , 443-448. 


A brief oral test was given to registrants claiming 
illiteracy in order to learn if their mental ability was 
sufficiently high for their acceptance by the Army. 
Although no attempt was made to classify subjects as to 
exact mental age, the results of this test compare favor. 
ably with scores on the Kent Emergency Test, indicating 
that a short series of questions on everyday topics can be 
an objective, useful estimate of intelligence. L. Bouthilet, 





Mitrano, Anthony J. “The Relationship Between Age 
and Test Performance of Applicants to a Technical- 





Industrial High School.” Journal of Applied Psy-¥ { 


chology, XXVI (1942), 482-486. 


The MacQuarrie Test of Mechanical Ability, the 
Revised Alpha Intelligence Examination (Wells Revi- 
sion No. 7), and the Revised Minnesota Paper Form 
Board Test (Series AA) were given to 389 eighth grade 
pupils who applied for admission into the ninth grade 
of the technical-industrial high school. The results show 
consistently that, out of the age range 13 to 16 inclusive, f 
the younger pupils are likely to be the more capable. 
K. S. Yum. 





Moore, Herbert. “Real Use for Rating Scales.”’ Person- 
nel Journal, XXI (1942), 165-170. 


Ratings are not exact measuring rods. They should f .. 
be used for corrective purposes as specific suggestions. fF 
The author calls attention to their place in regard to use, F 
contents, and form. A judgment made is an interpreta f 
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tion and qualities judged are abstractions. Suggestions 
are given for improving ratings, showing results of bet- 
ter method, and illustrations of rating scales as clinical 
tools. K. S. Yum. 





Pintner, R. “Intelligence Testing of Partially-Sighted 
Children.” Journal of Educational Psychology, 
XXXIII (1942), 265-272. 


A group of 602 children ranging in chronological age 
from 10 to 12 years inclusive, was tested by the new Re- 
vised Stanford-Binet Test. The visual material of the 
test was enlarged in order to avoid any possible handi- 
cap due to visual defect. Many re-tests at different inter- 
vals were given, some with the standard material, and 
some with the enlarged. The results show that there 
seems to be in general no obvious handicap. The mean 
I.Q. for partially-sighted children is a few points below 


' normal. The author, however, recommends the enlarged 


visual material for these children. K. S. Yum. 





Rugg, Donald and Cantril, Hadley. “The Wording of 
Questions in Public Opinion Polls.” Journal of Ab- 
normal and Social Psychology, XXXVII (1942), 
469-495. 


The extent to which the wording of questions influ- 
ences the answers obtained depends on the degree to 


' which the respondent has or has not reliable standards 
| of judgment resulting in stable frames of reference. 
| Numerous studies show a considerable variation directly 
_ due to effects of context, kinds of alternatives, and devia- 
_ tions from “objective” wordings. What particular tech- 
_fique or techniques should be used is therefore a func- 
| tion of the nature of the particular issue under investi- 
| gation. Whenever possible, the split-ballot technique 
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should be used for testing the stability and consistency of 
opinion. K. S. Yum. 





Ryan, T. A. and Johnson, B. R. “Interest Scores in the 
Selection of Salesmen and Servicemen: Occupational 
vs. Ability-Group Scoring Keys.” Journal of Applied 
Psychology, XXVI (1942), 543-562. 


The authors are concerned with the validity of inter. 
est measurement in selecting salesmen and servicemen 
for machine accounting services, and the relative value 
of two distinct kinds of scoring key for the Strong Inter. 
est Blank, the occupational key and the ability-group 
key. The data obtained indicate that the ability-group 
key has definite promise as a selective device in both of 
the occupational groups under investigation, although 
previous investigators have questioned its value. Rating 
by the district manager and the sales manager are criteria 
of success. K. S. Yum. 





Schneidler, G. G. and Paterson, D. G. “Sex Differences 
in Clerical Aptitude.” Journal of Educational Psy} 
chology, XXXIII (1942), 303-309. 


Tests which involve the checking for identities} 
or differences of paired numbers and paired names were 
given to boys and girls in grades from V to XII inclu. 
sive. The results consistently indicate a striking difference } 
between sexes, which is difficult to explain at the present 








time. Some hypotheses are offered. Louise T. Grossnickle. 










Selover, Robert B. “A Study of the Sophomore Testing | 
Program at the University of Minnesota—Part II’) 
Journal of Applied Psychology, XXVI (1942), 456F 
467. 
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MEASUREMENT ABSTRACTS 


By means of R. A. Fisher’s discriminant function, it 
is possible to determine the constants in the equation 
which maximizes the difference between any two groups 
and makes use of all the information given by the test 
scores. This technique should be useful in determining 
whether the test performance of a given student resem- 
bles the performance of one group of successful individ- 
uals more closely than that of another group. As illus- 
trations the author reports a comparison of the profiles 
for a group in pre-medical studies and music and a com- 
parison between profiles of groups in natural science and 
English, together with some individual cases for voca- 
tional interpretation. K. S. Yum. 





Smith, A. W. “Observation and Testing.” Personnel 
Journal, XXI (1942), 175-179. 


The Psychometric Laboratory of the Portland Public 
Schools uses a battery of 29 aptitude, interest and tem- 
perament measures accompanying an observation sheet 
taking into consideration anything seeming to be signifi- 
cant in the behavior of the testee. The essential point is 
that a psychological test is more than a measuring device. 
Louise T. Grossnickle. 





Street, Roy F. I.Q. Changes of Exceptional Children. 
Journal of Consulting Psychology, V1 (1942), 243- 
246. 


Of 1318 children in the public schools of Battle Creek 


| tested since 1931 with the Stanford-Binet (original or 

revised) because of a need of special attention of some 
ng} kind, 920 have been retested at least once. Of this num- 
6.) case 
» available medical, dental, social, psychological, and edu- 


ber, I.Q. changes of 10 points or more were noted in 43 
cases. These case records were studied with reference to 
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cational information. Several generalizations about pog 
sible conditions of this variability are mentioned; one j 
the shyness or negativism which limited several children! 
free self-expression on the original test; but no sing 
cause can account for all cases of variation. The need i 
stressed for caution in individual prediction on the basi 
of too limited data. F. A. Kingsbury. 





Taylor, K. Van F. “The Reliability and Permanence af 
Vocational Interests of Adolescents.” Journal of E 
perimental Education, XI (1942), 81-87. 


The Strong Vocational Interest Blanks for men 
women were given to 64 high school boys and 62 higl 
school girls over a four-year period of seriation testing 
The author finds that the results are similar to those ¢ 
tained by investigators employing adult and colleg 
populations. The reliability and permanence of measure 
interest scores are adequate for use in the upper gradé 
of the secondary school. Louise T. Grossnickle. . 





Waite, W. H. “The Relationship Between Performance 
on Examinations and Emotional Responses.” Journa 


of Experimental Education, XI (1942), 88-96. 


The data were obtained from 60 boys, three separati 
readings for each physiological function. On the thirt 
reading, a written examination consisted of three parts 
number series, word completion, and artificial languag 
Four types of study were undertaken. The results indicat 
a general pattern of response for some physiologic 
measures and some association of heart and respiratid 
rates with success or failure on examinations of varyif 
length. Louise T. Grossnickle. 
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